WORLD INTELLECTUAL PROPERTY ORGANIZATION 
IntematioiuU Bureau 




INTERNATIONAL APPUCATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classiacation ^ : 

G06F 17/00, 17/60, G06K 5/00, 7/10, 
7/00, 7/12 


Al 


(11) International Publication Number: WO 97/32262 
(43) International Publication Date; 4 September 1997 (04.09.97) 


(21) Intematioiial AppUcation Number: PCT/US97/03330 

(22) International FOing Date: 28 February 1997 (28.02.97) 

(30) Prioritj Data: 

08/609.549 1 March 1996 (01.03.96) US 

(71) Applicant: CX)BBLESTONE SOFTWARE. INC. (US/USJ; 76 


(81) Designated SUtes: AU. CA, CN. IL. JP. European patent (AT 
BE. CH, DE. DK. ES. Fl, FR. GB. GR, IE. IT LU MC 
NL. PT, SE). 

Published 

With international search report. 

Before the expiration of the time limit for amending the 
claims and to be republished in the event of the receipt of 
amendments. 



Lowell Street, Le^cington. MA 02173 (US). 



(72) Inventors: ANTOGNINI. Thomas; 76 Lowell Street. Lexing- 
ton. MA 02173 (US). ANTOGNINI, Walter, 440 East 20 
Street New York. NY 10009 (US). 



(54) Title: VARIABLE FORMATTING OF DIGITAL DATA INTO A PATTERN 
(57) Abstract 

A method of formatting digital data and a method of decoding the formatted digital 
data. User selectable fonnat parameters (201) vary the dimensions and other attributes of 
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VARIABLE FORMATTING OF DIGITAL DATA INTO A PATTERN 



5 Copyright Notice 

A portion of the disclosuie of this patent document contains material which is subject to copyright 
protection. The copyright owner has no objection to the iacsimile Feproductlon by anyone of the patent 
disclosure, as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves ail 
copyright rights whatsoever 

10 

Background of the Invention: 

This invention relates to the formatting of digital data into a pattern, encoding that pattern onto a 
5ut)strate where appropriate, and decoding that pattern to reconstruct the digital data. 

While computers have substantially enhanced the manner in which society conveys and works with 
15 information, paper remains the favored manner of conveying information. Indeed, the proliferation of 
personal coix^MUers has resulted is a prolifefation of paper. Yet, no technology to date has significantly 
integrated the digital environment of the computer with the visual environment of written media. Instead, 
un i ijii iii i s jirmuiily direct human readable information to be placed on paper. 

It would be greatly advantageous to have digital data placed on paper and other media currently 
20 used for human readable information. Such a method would link the largely separate environments of paper 
and computers. The method could store and convey digital data with greater efficiency, ease; speed, and 
lesser cost than any other available method. The method would have the further advantage of being the only 
significant method to integrate digital data with visual media. 

As described below, the prior ait discloses methods for placing machine readable information on 
25 media such as paper. However, none of these prior art methods, and, to the best of the inventors* knowledge, 
no other technotogy currently available to personal computer users allows for the placement of a significant 
amount of machine readable information on the media. Other practical limitations of these prior art methods 
forestall significant commeicial success. 

One exanq>le of digital information being stored on paper is the use <tf bar codes. Because standard 
30 bar codes are one dimensional, they are severely limited in the number of bars that may be tised to store 
digital information. The limits are somewhat greater in the case of two-dimensional bar codes but these 
limits are still ^ more restrictive than the theoretical bmits of any particular printer, and bar codes are 
designed for use with specialized scanners. For more infonnation on bar codes, sec "Information Encoding 
with Two-Dimenstonal Bar Codes," authored by T. Pavlidis. J. Schwartz and Y. Wang, COMPUTER, June 
35 1992. 

U.S. Pat No. 5,245, 165, issued to Zhang, discloses a self-docking glyph code for encoding dual bit 
digital values of a logically ordered sequence of wedge-shaped glyphs that are wriaen or otherwise recorded 
on a hardcopy recording medium in accordance with a predetermined ^atial formatting rule. The dual bit 
values are encoded in the relative rotations of the glyphs. The glyphs are decoded by determining a bounding 

I 
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box for each glyph and determining either which quadrant of the box contains its center of mass or by 
comparing the reJative locations of the shonest and longest runs of ON pixels. To reliably present a single 
bit of data, each glyph comprises a large number of pixels, and thus this technology requires considerable 
space on the recording medium. The technology does not optimize the use of space or computational 
5 resources by presenting a bit in the most compact fashion. 

U.S. Pat. No. 5,337,362, issued to Gormish, discloses a method for transferring digital information 
to and from plain paper. The method involves storing data in at least one box on the paper, the box 
including a frame or border having alternating pixels along the left and right edges for use in determining 
the current location of a horizontal line of pixels when reading the data and having pixels in comers of the 

10 fraine to detennine hori2x>ntal spacing between pixels within the box. Binary data is formatted in rows 

within the box, wherein a bit of digital data is depicted by the presence or absence of an ink dot. The method 
disclosed by Gonnish provides the ability to represent 60 kilobytes of data on a single page. 

Although Gonnish allows for the storage of more data on a page than can currently t>e stored in text 
form, it has several problems which prevent it from being useful in a commercial environment. For example, 

15 Gormish requires a thick frame to be placed around the entire data box in order to locate the box, which 
hmits the ability to place the data in convenient shapes and sizes on a substrate. Also, Gormish requires 
placement of pixels in a rigid ^hion, without provision of guideposts to determine where to search for the 
presence or lack of a dot other than on the borders ofthe boxes. Far&errGoTmidi^n3fVHles'iifeTriaeemem:in 
an ink dot that covers an entire square and that square covers an area 16 times larger than the finest optical 

20 resolution of any given scanner (e.g.» Gonnish discloses printing dots at 50 dpi while scanning is performed 
at 200 dpi), thereby limiting the density of data which can be represented on each page. In addition, 
although the method disclosed in Gonnish may be suited for certain printers and scaimers of great precision 
it does not adequately accommodate for deviations from perfection in printing and scanning found in ofTKhe- 
shelf printers and scanners designed for use with personal computers. Operating in an environment of 

25 personal computers aiKl their peripherals, this rigidity ultimately translates into loss <^ data density, higher 
error rates, slower processing speed, ail of these deHciencies, or, worse yet, complete itiability to use the 
method in given computer environments. 

Other known methods disclose manners in which a single cell contains more than one bit of 
information through the use of gray scales. One such method is disclosed in U.S. Pat No. 5.278,400, issued 

30 to J. Appel ( 1994). This patent discloses the encoding of multiple bits in a single cell by marking, preferably 
by binary marking, a predetermined number of pixels in a cell irreq)ective ofthe location ofthe pixels within 
the cell. The number of pixels marked corresponds to the data to be encoded. The markings on the substrate 
are decoded by detecting the gray scale level at each pixel of the cell converting that gray scale level to a 
corresponding digital signal and summing all of the digital signals corresponding to all of the pixels in the 

35 ceU. This method requires discrete determination ofwhere the cell begins and ends. The gains from 

encoding multiple values in a single cell are lost by requiring larger cells, relative to straightforward binary 
printing. Gonnish also discloses the encoding of multiple values in one cell through the use of gray scale 
inks. This method employs rigid formatting and printing described above and similarly relies on rigid 
decoding mechanisms that may be optimized for a particular combination of a printer and a scanner, but not 
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for all such combinations. These methods give back the data density and savings in computational resources 
that the use f multiple colors should provide. 

U.S. Pat Doc. No. 5,329»107, issued to D. Priddy and R. Cymbalski (1994), discloses a method to 
dynainically vaiy the size, fonnat, and density of machine readable binary code. The method disclosed in 
5 that document provides a code formed of a matrix and allows variation in the amount of data in the matrix by 
printing on two sides of the perimeter of the matrix broken line patterns of alternating daricened and 
lightened areas. The method determines the amount of data in the matrix from the product of the number of 
lig^uened areas and darkened areas of the first side and the number of lightened areas and darkened areas of 
the second. The method determines size of the matrix by measining the other two sides of the perimeter, 

1 0 formed of two solid black lines. While the method allows the encoder of information some flexibility in 
accommodating the different potentials of higher and knver resolution scanners, the method is rigid in 
daikening entire square cells. The method also lacks regular reference markers and generally limits 
information about the encoding, conveyed in the matrix, to size and density. The method therefore lacks the 
flexibility needed to address the peculiarities of cvezy combination of printer and scanner. Hence the method 

1 5 can not produce the greatest density of data or the roost efficient maimer of decoding for every combination 
of primer and scanner. 

There is a need to substantially increase the amount of data that can be stored within a given amount 
Qft pap r r-in'Or de FTTrT.mi i iK.iL w ifee^g channels of storage and communication such as floppy disks and 
digital communication by telephone. Employing binaiy printing (i.e., storing one bit per cell), the most basic 

20 and least dense printing process, the invention is capable of storing data at densities several times as great as 
any other paper based method known to the inventors. Utilizing printing methods which store more than one 
bit pa* cell, such as^lor printing, the theoretical density limits increase substantially. 

While Gonnssfa disdoses the ability to store 60 kilobytes on a single page using a 400 dpi scanner, 
the invention is capable of encoding and decoding over 160 kilobytes of data error free (Le., by utilizing error 

25 correction) using just a 300 dpi scanner. With the aid of compression, this single page can contain over 500 
kilobytes of text With a 600 dpi printer and a 600 dpi flatbed scanner, the im^mion can encode data in cells 
1/200 inch square (i.e., .005 inch x .005 inch), successfully encoding and decoding over 300 kilobytes of data 
before the benefit of any compression, in excess of 1 megabyte of text with the aid of compression. Utilizing 
more precise printing processes and a 600 dpi flatbed scanner, the invention encodes and decodes over 7,000 

30 bytes per square inch (over 1,100 bytes/cm^), over 20,000 byics of text using compression. Utilizing an 
ordinary thermal £uc machine as a scaimer (achieving a binary scan of approximately 200 dpi), the invention 
encodes and decodes over 50 kilobytes of data, over 150 kilobytes of text with the aid of compression. All of 
the above de ns itie s are accomplished utilizii\g binaiy printing. 

The invention also conveys advantages for any particular printer. For example, using an ordinary 

3 5 thermal fax machine the invention can print over 230 kilobytes of data, over 675 kilobytes of text with 
compression, on an 8.5 by 11 in. piece of thermal fax paper. The invention can then successfully decode 
that data error free. 

Summary of the Invention: 

3 
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Ii is an object of the present invention to solve the problems discussed above present in prior ait 
systems for representing digital data on a substrate. 

n is another object of the present invention to greatly increase the densi^ at which digital data can 
5 be represented on a substrate. 

It is arK>ther object of this invention to overcome the Umitations of prior art through a method that 
writes and reads digital data on paper and other media using off-the-shelf personal computers and 
peripherals, and achieves the full carrying capacity these off-the^hclf components can sustain. 

It is another objea of the invention to dcteraiinc and enable the features and parameters that 
10 contribute to density of information on a printed substrate, and to enable full generality in formatting and 
decoding along the dimensians identified. This satisfies in turn the ultimate, practical goal: achieving the 
maximum density possible for airy particular combination of printer and scanner. This comes about because 
that point of maximum density can always be found in the multi-dimensional space so defined. 

It is another object of the present invention to provide flcxibUity in printing digital data onto a 
1 5 substrate along with other information. 

These and other objects of the invention arc achieved by a method of formatting digital data into a 
pattern where the pattern comprises a number of cells (i,e,, predetermined spaces in the pattern) with known 
dimensions where each cell conveys at least one bit of data by expressing one^ at l^nwo logical states 
where one logical state is expressed by the presence of spot with a given set of attributes in the ceU and a 
20 second loguai state is expressed by the absence of a spot with those attributes from the c^^ andwherethe 
size of spots may be different from the size of cells containing the spots. 

Generally speaking, in accordance with the invention, a method of formatting data irrto a pattern in 
an optimal fashion is provided. The preferred embodiment of the invention provides for the placement of ink 
on paper. The preferred embodiment allows the person providing data to format the placemem of digital 
25 data. This flexibility in formatting the placement of digital data allows the person providing data to opdmize 
for any particular combination of encoding device and scanner. The method of encoding allows the person 
providing dau to format the placement of ink in a fashion that best reflects the printer's capabilities to place 
ink in a designated area. The method of encoding also allows for formatting designed to consider the 
strengths and limitations of the target audience of scanners. 
30 The features that support encoding information on Che printed substrate, and its effective decoding 

via a scanner, fall under two heads. First, there are dark regions on the substrate, which the current 
invention terms "qwts." whose presence or absence in a specified region represents digital bits. Second, 
there are guideposts, which the present invention terms "markers^** that serve to identify the^ocattomof^spots 
on the printed substrate - a function known in the an as **clockingr The present invention explicitly 
35 decouples these two feanires, allowing them to be varied independently, so that each may be optimaUy 
configured for its distinct purpose. The current invention also permits each to be varied across all the 
dimensions (e.g., those defining size, spacing, and frequency) that affect the density of information on the 
printed substrate, while supporting its effective decoding. This full generality allows the optimum match for 
a particular printer and scanner always to be selected, formatted, and decoded. 

4 
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The method of the present invention allows the person or computer encoding data to select the size, 
in pixels, of both the cell containing a bit of information and the size of the printed spot where a spot is 
required. The preferred embodiment of the method of encoding provides a bit of one value by placing a spot 
of the chosen size in the cell of the chosen size. The method provides a bit of the opposite vahie by leaving 
5 the cell of the chosen size blank. In accordance with the invention, the size of the spots and of the cells can 
be varied in both the width and height directions. 

The method of the present invention also allows the person or computer system encoding data to 
select the size and locations of markers. In accordance with the invention, the size and location of the 
markers can be flexibly altered to achieve reliable clocking with the minimum amount of space and 
10 computation time. 

The method of the preferred embodiment provides information about the encoding process thrtnigh 
use of a "metasector", a header physically separate from the main bodjy of data. The purpose of providing a 
metasector is to facilitate decoding the main body of data. In this embodiment, the mctasector is itself an 
instance of the general pattern by which information is stored in the invention. This metasector is preferably 
15 printed at a resolution which can be easily and reliably scanned and interpreted. It is also givwi a pxedictablc 
and relatively rigid format, which makes it straightforward to decode in the absence of detailed information 
about the printing process and environment which generated the encoded dau. This metasector contains 
infonnationa facmt thft^prinring prnrrss and r nw ii n i m i r n i fhm i^ 4hen used to decode the main body of data. 
The somewhat rigid format of the metasector frees the main body of the data from rigidity in its own format, 
20 allowing it the greatest flexibility in achieving maximum density. The metasector, encoded at a relatively 
low resolution, contains information communicated to the remainder of the method in order to decode 
information at a higher resolutioa The information included in the metasector includes, inter alia, the size 
of the dau spots printed, the size of the cells containing data spots, the printing process used to print spots 
and the size and relative location of markers, if any. 
25 Allowing flexibility in the size and placement of data spots in cells greatly increases density of data 

and improves the speed and accuracy of determining whether a bit is on or off. The fundamental purpose 
behind defining ^t size independently is twofold - first, to compensate for printer deficiencies and, second, 
to compensate for scanner deficieixnes. 

Within types of printers, such as 300 dot-pcr-inch ("dpi") laser printers, there is variation in both 
3D the ability to place ink at a given location and the abiUty to keep ink within the spot designated by that 
location. For example, primers have varying degrees of "dot gain" - the tendency of most printers to place 
ink beyond the purported boundaries of the pixel. Dot gain, and the problems it causes, can be exacerbated 
"'^^^''^^^'CTprrating^pitioessOTqrtDyedsg steps. If, for example, the printing process 

invokes producing film from a print, a plate from film, and copies from the plate, increasing amounts of dot 
35 gain can occur in each step. A spot is preferably allowed to be defined to be smaller than its cell (ic, the 
space that is supposed to contain the spot) simply to prevent spots from spilling over to adjacent cells. 

Even with perfect printing, however, it would be important to aUow smaUer spots than cells, because 
of a second phenomenon. Scanners chatactcristteally "leak" dark intensities from one pixel to a directiy 
adjacent pixel. That is, if a pixel is direcUy over a dark region on the printed substrate, and an adjaccm pixel 
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is not, the imenstty of the adjacent pixel is nonetheless supprased to a darker value. When spots completely 
fUl in their cells, the cells must be made larger to compensate for this tendency of scanners. If they are not 
made larger, the neighboring cell when blank may not differ enough in intensity from the dark cell to be 
discriminated as blank. Making it possible to configure spots to be smaller than cells generally allows ceUs 
5 to be smaller while supporting correa discrimination between dark and white cells. 

Of course, it is possible in principle that a given printer (or a like device) may charactensticaliy 
priiu smaller spots than defined, or a given scanner (or a like device) may "leak" bright intensities — in 
which case it would be useful to define spots to be marginally larger than the cells they occupy (or, 
alternatively, to print spots in reverse video.) 
10 Between types of scanners or types of printers, such as between a 360 dpi inkjet printer and a 600 

dpi laser, the degree of variation expands significantly. Laser printers have a greater precision in the 
placement of ink, and 600 dpi printers place ink more accurately than a 360 dpi printer. The invention 
provides a method critical to optimization of ink placement based on these variations. 

The ability to vary the dimensions of spots aiul cells in both horizontal and vertical directions also 
15 serves to maximize the density of information. For example, with a 200 dpi thermal fax printer, and a 400 
dpi scanner, the invention can encode and decode a pattern with cells of 1x2 pixels containing spots of 1x2 
pixels, thus encoding over 100 kilobytes of data on a single page. However, a 400 dpi scanner canm>t 
reliably decode a pattern with spots of 1x1 pixels printed at 200dpi. Since the next step up from lxJ-iSrlx2 
(or, equivalently, 2x1), the most con^)act representation is employing the 1x2 cells. If the technology could 
20 allow for only square cells, the next step up would be 2x2 cells, which would be only half as compact. 
A powerful use of the invention, beyond its ability to conununicate and store information 
(documents, software, graphics, etc.), is as an enabling technology for other technologies. One of the great 
limiting factors in permitting most consumers to fully exploit their PCs is that the PC possesses simply too 
many distinct functionalities that must be learned. This is indeed a problem that promises to get only worse 
as the PC itself develops greater capabilities. Even today, a PC user may have fax and data communication 
software on the user's PC, and a ccess to the Internet, and the ability to use the PC as a telephone, and many 
other functionalities. Yet it is a rare user who will know how to utilize all of these functionalities. The 
present invention can be used to encode on paper an arbitrarily conq}licated batch file, script file, application 
file, or executable file that can effectively navigate the user through all the complexities involved in each 
function the PC can perform. By a simple scan of a datatile, for instance easy as nmning a copier — all 
such functions can be invoked A datatile can contain both the identity of the application to be invoked — 
e.g., data communication, fax conununication, Internet access — and the sequence of actions and data that 
that function requires — e.g., the phone number that must be dialed, the account number of the user, the 
password that must be entered, the particular address on the Internet sought, and/or a fiag for the particular 
fuiKtion that should be performed when access is granted. In effect, the datatile enables paper to become the 
user interface, instructing the user as to the functions that will be perfonned - e.g., a bill will be paid over 
the Internet, or a ^ back will be initiated. The scan becomes the single thing that the user must learn to do: 
all other functions can be performed automatically. This spares the unsophisticated user the perhaps 
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ovcrwhelmiiig task of learning how to invoke these ftinctions. and saves the sophisticated user from the 
tedium of entering the point dicks and detailed information aiiy of these fonctions demand. 

Several features of the invention's methods of encoding and decoding make practical for the first 
time the enabling of many further, simplifying, technologies. The ability to significantly increase density of 
5 data allows far more complicated instructions to be placed in any given amount of space. The ability to 
accommodate a wide audience of printers and scanners allows access to the greatest number of potential 
users. The ability to vary the shape, dimensions, and location of the encoded digital data on the substrate 
allows the greatest flexibility in formatting the digital data alongside other information (such as text or 
graphics) on the substrate. 

10 Further objects and advantages of the invention will become apparent from a consideration of the 

drawings and ensuing descriptions. 



Brief Description of the Drawings 



1 5 The present invention will be understood more fully from the detailed description given below and 

from the accompanying drawings of the preferred embodiments of the invention which, however, should not 
be taken to Umit the invention to the specific embodiments, but are for explanation and understanding only. 

FIG. L is a block diagram describing the overall process for transmitting digital data pursuant to one 
20 embodiment. 

FIG. 2 is a block diagram describing the method of encoding digital data onto a substrate, according to the 
preferred embodiment. 

FIG. 3 is an enlarged portion of a digitally encoded std>5trate illustrating how the method of encoding 
converts a series of digital data values into a pattern. 
25 FIG. 4 is an enlarged portion of a digitally encoded substrate illustrating an embodiment of the method of 
encoding where markers are light areas inride dark bars. 
FIG. 5 is a dialog box for establishing shapes for spots and cdls. 

HG. 6 is a dialog box for determining bow cell shapes fit together and the sequence in which cells are 
created and each bit in the series of digital data values encoded. 
30 FIG. 7 is a block diagram descrilmig one implementation of the process for selecting format parameters. 
FIG. 8 is an enlarged digitally encoded substrate produced by the method of encoding, where the substrate, in 
this instance, is paper encoded with the placement of ink. 

HG.-9iilfai srTa tcs ^a^s iifastiaMtp nidn ix ri^ by^a^fimta^ in which both machine 

readable encoded digital data and human readable text and graphics is placed on the substrate. 
35 FIG. 10 illustrates a substnUe produced by an eniboditnent of the invention in which parts of a da^ 
placed in noncontiguous regions of the substrate instead of being placed as a whole in one region of the 
substrate. 

FIG. 1 1 illustrates a digitally encoded substrate containing multiple datatiles, each of which has been 
enlarged for illustration purposes. 

7 
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FIG. 12 iUustrates a digitally encoded substrate containing multiple datatiies, shown at their actual sizes. 
FIG. 13 is an enlarged view of a portion of a digitally encoded substrate illustrating an embodiment in which 
each cell contains one bit f digital data expressed by spots with different attributes, where the difference in 
attributes is a difference in spot size. 
5 FIG. 14 is an enlarged digitally encoded substrate produced by a further embodiment of the invention in 
which each cell reprcsenu a plurality of bits where spots of different sizes and colors express different logical 
states. 

FIG. 15 is an enlarged view of a portion of a digitally encoded substrate illustrating an embodiment of the 
method of encoding in which one spot size and two cell sizes are defined. 
10 FIG. 16 is a block diagram describing the method of decoding for decoding digital data contained on a 
digitally encoded substrate, according to the preferred embodiment. 

FIG. 17 is a block diagram describing the decoding process for deriving a series of digital data valu^ from 
an image of a digitally encoded substrate. 

FIG. IB is a block diagram describing the recovery process for deriving a series of digital data values from 
1 S the image of that portion of a digitally encoded substrate that lies between markers. 

FIG. 19 is an enlarged view of a portion of a digitally encoded substrate illustrating one embodiment of the 
recovery process used to recover digital data. 

FIG . ?O Js.a blodc diagram illustrating a hnther embodiment of the method of encoding in which the digital 
data is subjected to encryption prior to encoding. 
20 FIG. 21 is a block diagram illustrating the addition of decxypdon to the method of decoding where the 
method of encoding included caciyption prior to crKoding. 
RG. 22 is a block diagram describing a method of transmitting digital data. 

FIG. 23 is a block diagram describing a method of transmitting digital data involving immediate use of the 
digital data transmitted on the substrate. 

25 RG. 24 is a block diagram describing a further embodiment of a method of transmitting digital data, 
including transmission of a digitally encoded substrate, that method being by facsimile transmission 
RG. 25 illustrates a further embodiment of the invention in %duch both machine readable encoded digital 
data and human readable text and graphics are placed on the substrate and in which the encoded digital data 
is designed to cause a computer to reproduce on the computer's display the human readable text and graphics 

30 placed on the substrate as well as allow context sensitive interaction with the computer. 

Detailed Description of the Preferred Embodiments 

The preferred embodiment operates on a personal con^mter having an 80386 model microprocessor 
35 or higher, at least 4 MB RAM, using the Wiiuiows® operating system available from Microsoft Corporation 
of RcdnK>nd, Washington, and available hard disk space of at least 10MB. The preferred embodiment 
supports Inkjet and laser printers, grayscale flatbed, handheld, and sheetfed scanners, and thermal, inlget, 
and laser fax machines. Of course, one ddiled in the an will recognize that the method and system of the 
present inrvcntion can be implemented on any computer system using any appropriate operating system. 

S 
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FIG. 1 illustrates the overall process of transmiuing digital data, according to one embodiment of 
the invention, it being understood that the details of the invention itself arc described below. The data source 
comprises digital data. The source, preferably being computer files stored on a personal computer's fixed 
disk, may also be from a floppy drive, visual images input by a scanner, digital data input by a scanner, files 
5 stored in memory, as might be the case, for example, of a word processing document input through a 
keyboard, or any other source capable of producing digital data. The program encodes this digital data on a 
substrate, step 101, producing a substrate with the digitally encoded data. The program then places the 
digitally encoded substrate in the hands of the ultimate user of the digital data, step 102. The ultimate user 
scans and decodes the digitally encoded substrate, step 103, which itisults in the reconstruction of the original 
10 computer files or other digital data. The overall result of the process described in FIG. 1 is the transmission 
or storage of digital data, with a substrate such as paper being the medium for that storage or transmission. 
Each of these steps will now be described in greater detail. 



15 



ENCODING 

no, 2 Ulustiatcs the method of encoding of the preferred embodiment of the invention. Selection 
step 201 requires selection of various format parameter values. The parameters include the height and width 
in primer pixels of each printed data spot, the height and width in printer pixels of each cell, the height and 
width in printer pixels of the markers, anrf Mariri-r t» gp»t: .h^ ^jqtaTTn-||,,pnp|^p i^pj , l i r i w rrTi mi>rir.>rc 
and the data spots. Marirers, the fimction of which is described more fully below as part of the decoding 
20 process, are guidcposts contained in the preferred embodiment that allow for more precise determination of 
the center of rows and columns of data spots. The person encoding data may also vary the number of cells 
between maifccrs. The Spots per Segment parameter establishes the number of cells (and thc^ 
maximum number of possible spots) located horizontally between columns of mariccre while Rows Per 
Marker establishes the number of cells located vertically between markers. Hence, the preferred embodiment 
25 aUows the person encoding date complete flexibUity in fbrmatdng spots, cells a^^ 

The preferred embodiment contains further parameters, allowing fiexibUity in the formatting of 
datasectors and aUowing the person encoding data toindicatetheopeof primer to be used. A datasector of 
the invemion is a subdivision of a datatile and a datatile is an overall pattern of digital data complete with all 
components needed by the method of decoding. A datasector represents the smallest accumulauon of data 
30 cells which, when decoded, can reconstruct a stream of digital data without errors, by employing error 
correction. That is, a stream of data of a certain length is first transformed into a sequence of codewords, 
with redundancy for error correction. The bits composing this sequence of codewords may. in principle, be 
distributed anywherein a^datasectoi-butthcyinnm-al^^ 

datasector. The original stream can be reconstructed only after the cnUre datasector has been examined. 
35 The person encoding data may establish the parameter Data Segments, a measure of the number of 

data segments located across each datasector. A data segment is a row of cells located between columns of 
markers with the number of cells in the row determined by the Spots per Segment parameter. Hence, the 
parameter Data Segments varies the number of columns of maikcrs within a datasector. The person 
encoding data may also establish the number of Datascaors Across and the number of Datascctors Down the 
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datatile. In the preferred embodiment, the person encoding data must explicitly override the Datasectors 
Down parameter, that value being otherwise calculated automatically. 

The Printer Type parameter does not directly influence the formatting process in the preferred 
embodiment and. in that sense, may be considered something other than a format parameter. The Printer 

5 Type parameter allows the person encoding data to communicate information describing the printing process 
used to print the datatile. This information is preferably established automatically by reference to the printer 
currently selected in the computer's operating system, but tnay be overridden by the user. 

The Ink Colors and Ink Types parameters are set in the preferred embodiment to black and normal, 
respectively, but may be varied in other embodiments using different colors or types of ink. 

D A cell represents a part of the area covered by a datatile. A cell should be understood as being a 

space that should contain no more than one spot and a cell should be understood as ordinarily being a space 
large enough to contain an entire spot In the preferred embodiment, defining a cell size determines the size 
of the space that may contain no more than one spot, while defining a spot size determines the size of any 
spot in the cell. It should be imderstood that a ceil of the preferred embodiment is a conceptual construct 

S with no physical manifestation other than the space it occupies. The preferred embodiment applies the 
concepts of cell and spot by determining an array of pixels, with dimensions equal to the cell size, and 
determining within that array a subarray with dimensions equal to the spot size. If a spot is called for, the 
pirici i n l ^fJiilHMliwml ^aflis dots (Le., the placement of ink at a given printer pixel location) at each of the 
pixels within the subarray. The preferred embodiment does not print dots at any remaining pixels in the 

5 array representing the cell. Hence, a cell differs physically from a spot contained in the cell only by virtue of 
pixels that the printer skips over and only then if the cell has dimensions larger than the spot. 

Thus, if a cell is defined with dimensions M pixels wide by N pixels high, and a spot is defined with 
dimensions X pixels wide by Y pixels high, X should ordinarily be smaller than, or equal to M and Y should 
5 ordinarily be smaller than, or equal to N. It should be tmderstood that M, N, X, and Y are labels for 

numbers, where M is intended to express the width of a ceil, N the height of a cell, X the width of a spot and 
Y the height of a spot Of course, because they are labels, M, N, X, and Y could be replaced by any other 
labels, or the underlying dimensions could be expressed without labels, to accomplish the same effect 

) If at least one of the dimensions X or Y is defined as being less than the corresponding dimensions 

M or N, the spot will be smaller than its corresponding cell If the dimensions X and Y arc defined with 
different values, the spot will not be square. If the dimensions M and N are defined with different values, the 
cell will not be square. These possibilities allow greater flexibility to accommodate particular printers and 
scanners. 

5 

In step 202 of the preferred embodiment the person encoding data would select the computer file or 
files to be printed as spots on paper. The computer files would preferably reside on the encoding computer's 
hard disk. In other embodiments, the digital data to encode would come fiom other sources, such sources 
being limited only by the requisite ability to produce digital data. For example, digital data can be a stream 

10 
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of data that comes from an on-iine source, such as might exist on the Internet, and be directly formatted by 
the method of encoding without the intermediate step of saving data from that stream of data as a file on the 
computer of the person encoding data. 

5 The digital data from step 202 then passes compression processing 203 , if any. It should be noted 

that in the present invention, compression may or may not be performed. If compression is performed, 
various forms may be utilized, including both lossy and lossless compression techniques depending on 
whether the compressed data must be recreated in the exact form as the originai In the preferred 
embodiment the invention will decode the printed pattern to produce an error ftec stream of data. This 
10 allows compression techniques to be employed that do not require reconstruction from somewhat corrupted 
data of as much of the original information as feasible. In the preferred embodiment, standard compression 
into 2JP files is employed. In some instances, the impact of compression, such as increased data density, is 
so minimal that compression is not warranted. A further embodimem allows a user to circumvent 
compression. 

15 

Once any desired compression of the digital data has taken place (processing block 203), error 
correcUon encoding (processing block 204) may be performed. Since the substrate is used (along with the 
target scaimer) as a digital channel,.the errorcorrection of the (Mxsent invention can-be viewed as^inst 
another box with digital input and digital output Error correction encoding comprises adding correction or 

20 "parity- bits to the digital information. The method of error correction encoding can be any one of many 
methods known to those skUled in communicadons theory. The technique of error correction employed in the 
preferred embodimem is a straightforward and standard tedmique that derives from the Hamming distance 
theorem in communication theory. In the preferred embodiment the coding technique allows for the 
correction of at least two bit errors in any given codeword. The precise amount of redundancy is user or 

25 system selectable. It is useful to aUow for the correction of at least two bit errors, since a given codeword 
might be subject to more than one bit error even if its bits are distributed throughout a datasector to reduce 
the eflTecis of localired defects. If only one bit error could be corrected, even a single case of a codeword with 
two bit errors in the entirety of a printed pattern would cflFcctivcly corrupt the entire pattern. 

30 The preferred embodiment uses one method of error detection and correction (with user selectable 

degrees of redundancy) and one method of con^ression. In the preferred embodiment the degree of 
redundancy selected is information conveyed in the mctasector. In other embodiments other methods are 
used. Some of these further embodimaxtsraUon^the^useiktoiselectihemiethodST^^ 
correction and compression from a variety of possi'biliiies. In one embodimem, for example, the user can 

35 choose* as a fuitherforinat parameter, between lossy (c.g,, MPEG) and lossless methods of co^ In 
one such embodiment the user can choose, also a further format parameter, between various methods of 
error detection and correctiort including one that requires perfect digital accuracy, one that allows up to a 
selected degree of errors, and one that requires perfect digital accuracy for some data but allows up to a 

U 
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selected degree of errors for other data. The methods of error detection and correction and compression of 
these further embodiments are widely known to those skilled in the art 

It should be understood that compression can occur before any of the steps in FIG. 2. If so desired, 
5 the user can choose to employ any available compression technique to convert one computer file or data 
stream into a con^iressed computer file. For example, a stream of audio from a microphone cormected to a 
computer's sound card can be stored as an Adaptive Differential Pulse Code Modulation TADPCM**) 
compressed file. This already compressed file can then be selected in step 202. In a further embodiment, the 
user can choose whether to skip step 203 which would employ a second compression process. 

10 

Note that there is an advantage to using information about the formatting parameters to set the 
parameters for error correction. The organization of codeword bits on the printed page can be optimized 
using this information to reduce certain common types of defects introduced in printing, faxing, and 
scanning. In the present embodiment, the bits are separated within a datascctor In this maimer, error 
15 correction results where the plain paper starts with defects, sustains damage or the priming or scanning 
processes introduce defects. The preferred embodiment allows the user to vary the degree of error correction 
to reflect the quality of the target scanner or other drcumstanoes encountered or anticipated by the user. For 
fflcainplera hariri hrfftTOiiinff^TTOahHTOicalh^gBq greater error correction than a flatbed scanner of the 
same resolution. 

20 

Once the digital data has undergone compression processing 203, if any, and error correction 
processing 204; the digital data goes through formatting process 205. Formatting process 205 is done in 
accordance with all values selected for format parameters. Formatting process 205 of the preferred 
embodiment first creates a landmark — 2 dark l>ars which fiicilitate determining the location and orientation 

25 of the datatile as discussed more folly below in regard to the method of decoding. Formatting process 205 
then creates a metasector. The raetasector indicates the format parameters used in the method of encoding. 
Formatting process 205 is then re^nsible for changing a digital bit sequence into a pattern whidi is 
readable by the printer and from \Mch priiUed pixels can be produced such that the printed pattern can be 
accurately scanned. In the preferred embodiment, the formatting process produces a bitmap file which is 

30 then printed by any printer capable of printing bitmap files. The formatting process begins by exclusive- 
ORing the bit sequence with a known random sequence to create a relatively uniform appearance in the 
pattern on the printed page. The uniform appearance created can render a more aesthetically pleasing effect 
far theiprimeU pdiiemrwhicli can be important if the pattern is integrated with certain himmn readable 
material, such as an advertisement. The digital data is then fonnatted into black and white pixels, in which a 

35 "O" bit is stored as a blank or a white space and a ** I" is stored as a black spot with the dimensions in printer 
pixels as previously specified. 

In other embodiments, the digital data is formatted into different colors. Varying levels of gray 
scale is here regarded as one form of color formatting. In one such embodiment gray scale formatting is 

12 
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accomplished through binary printing by printing a known number of pixels (i.e.. the number of pixels 
needed to achieve a given level of gray scale) at arbitrary locations within the subairay of pixels that 
constitutes a spot 

5 In further embodiments, the digital data is formatted into differing levels of electric charge, as in the 

use of substrates capable of holding electrical charges, differing levels of magnetism, as in the use, for 
example, of magnetic inks, and differing levels of non-visible (eg., infrared) reflectivity, as in the use of inks 
with tu)n-visible light qualities, it being understood that the invention is not limited to these particular types 
of formatting or materials. 

10 

Data formatted through step 205 is output onto a substrate, step 206. In a preferred embodiment 
the step of outputting, step 206, includes communicating the formatted image torn a personal computer to an 
off-the-shelf laser printer, preferably a laser printer with a high resolutiorL In other embodimerus, the printer 
is an inkjet, dot-matrix, or LED printer, or any other printer capable of accepting graphic input from a 

15 computer. Further embodiments involve outputting digital data on substrates through means other than just 
communicating data from a personal computer to a connected printer. In one embodiment, a digitally 
encoded substrate produced, for example, by a laser printer ooiuiected to a personal compirter, is photocopied 
through commerciaUy available photocopiers. In a-fimheri ftfn h nri iinatt^-a.digitally eiicodcdTsii hs o atfc 
ptittted in colors, such as light blue, by oSsel or other printing processes, which such colors can be scaimed 

20 by a color scanner but not effectively photocopied with most photocopiers, thus preventing imfvoper 
photocopying. In a further embodiment, printing presses produce the digitally encoded substrates, either 
directly from the formatted image or indirectly by copying a digitally encoded substrate. In a yet further 
embodiment, a rubt)er stamp or other solid material, produced in the likeness of a datatile, is used to place 
ink or other substance on paper. 

25 

The paper used for printing can be any paper capable of accepting and holding the placement of ink 
including, for example, postcards, business reply cards, business cards, newsprint, magazine paper, self- 
adhesive paper notes, labels, forms, envelopes, cardboard, and checks. In the case of business cards, the 
digital information could include a database or additions to a database consisting of a person's name. 
30 telephone number, address, e-mail address, picture, audio file (e.g., a sound clip of the person speaking his or 
her name) and other pertinent information together with computer instructions that initiate a telephone call 
to the included telephone number. 

In still further embodiments, the outputting of digital data on a substrate invohres processes other 
35 than printing ink on paper and outputting stq) 206 should be understood to include any means for outputting 
digital data onto a substrate. In one embodiment, the outputting involves placing the encoded digital data on 
paper by changing the characteristics of the paper such as occurs when a facsimile machine prints using 
thermal fax paper or when the paper is burned (through the use of lasers or otherwise) or when holes are 
produced in the paper. In one embodiment, reflective substances are placed on such non-paper substrates as 

13 
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cloth (eg., shirts, towels, bags), ceramics (e.g., mugs, glasses* and plates), and buttons. In one embodiment, 
the outputting of digiul data occurs through photographic processes that place the digital data on a 
photographic prim or slide. In another embodiment, the outputting occurs by producing plastic objects (e.g., 
plastic labels, and cards) containing a dalatile. In a further embodiment, the outputting occurs by selectively 
5 magnetizing a substrate capable of retaining such a charge. In a sUU fiirther embodiment, the outputting 
occurs through processes that act upon a substrate of biological agents capable of being differentiated in 
discrete locations in at least two separate stales. For example, the hide or skin of animals (or their imemal 
organs) and the sur^ice of plant matter can be marked, such as with tattoos or branding, with datatiles. In a 
yet further embodiment, the outputting occurs not through the placement of substances on a substrate but by 
10 the removal of substances from a substrate as occurs through, for example, etching of metals, plastics or other 
materials, or Oie creation of pits in a compact disk. It should be understood that printing step 206 is riot 
limited to the embodiments described above, but could include any means of outputting digital data on a 
substrate of any type capable of being differentiated in at least two different states in each of a plurality of 
locations on such substrate. 

15 

FIG. 3 is an enlarged view of a portion of a digitally encoded substrate. FIG. 3 illustrates how the 
method of encoding takes a scries of digital data values (i.e., bit values) and, using those format parameters 
ai^kablc to spots, cells,^ markmr anrt^rnws OT Tte format parameter values used for 

producing the digitally encoded substrate of HG. 3 arc: Spot Height - 3, Spot Width « 3, CeU Height = 4. 
20 Cell Width = 4, Maricer Height = 3, Marker Wdth = 4, Marker to Spot = 6, Spots per Segment ^ 7, and 
Rows per Marker = 3. The scries of bit values for the first row of cells are: 1. 0, 1, 1, 1, 0, and 0. 

FIG. 3 reflects the bit values and format parameters selected, as illustrated in markers 301, distance 
from the first marker to the first spot 302, spot 303, and cells 304, 305, 306, 307. and 308, Each of the 

25 markers 301 is 4 pixels wide by 3 pixels high, consistent with a Marker Width value of 4 and a Marker 
Height value of 3 . Consistent with a Rows per Marker value of 3 . there are three rows of cells for each 
marker, the first row being immediately to the right of the first marker. Distance from the first marker to the 
first ^pot 302 is 6 pixels, consistem with a Marker to Spot value of 6. Each spot, such as spot 303. is3 
pixels high by 3 pixeU wide, consistent with a Spot Height value of 3 and a Spot Width value of 3. Each cell, 

30 such as cell 304. is 4 pbcels high by 4 pixels wide, coosisicnt with a Cell Height value of 4 and a Cell Width 
value of 4. The embodiment of the method of encoding utilized to produce the digitally encoded substrate of 
FIG 3 reflects each bit in the series of bit values by expressing one bit in each cell through two different 
logical?flatcsrwherc?onc suuc-is I cpiaeuted^by the presence of a s po t and the other logical state is 
represented by the absence of a spot from the cell. In this instance, a spot represents a 1 and a blank cell 

35 represents a 0. Accordingly, ccUs 304, 305. 306. 307, and 308 are spotted, blank, spotted, spotted, spon^ 
blank and blank, reflecting the series of bit values 1, 0, 1, 1. 1, 0, and 0. Sintilariy, the second row reflects 
the sches of bit values 1,1,0, 0. 0. 0. and 0. the third row reflects the series of bit values 0, 0, 1, I, 0, 0, and 
0, and the fourth row reflects the series of bit values 0. 1, 0, 0. 0, I, and 1, 

14 
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In the preferred embodiment of the method of encoding, a marker consists of a dark rectangular 
array f pixels. Series of markers are located in columns, with a number of white pixds vertically 
one marker from the next marker down the colunm, such number of pixels being a function of the values for 
formal parameters Cell Height, Rows per Marker and Marker Height Similarly, each marker is horizontally 
5 separated from the nearest possible spots by a number of while pixels, such number being determined by the 
value for the format paranneter Marker to Spot. FIG. 3 Ulustraics markers according to this piefened 
embodiment 



It is well recognized in the area of the invention that it is impoitant to have a '^clocking" mechanism 
10 to allow a precise mapping from image pixel locations to printed pattern locations. The present invention 
allows the clocking mechanism, which always demands some overhead in terms of space, to be configured so 
that it can maximize the density of information on the printed substrate. The clocking mechanism assumes 
the most compact form that allows it to represent spatial information: periodic dark interrupting white, or 
periodic while interrupting dark. The area occupied by ttiis mechanism is fiilly configurable: both the 
15 frequency with which it occurs, and the size of each occurrence can be fully modified. Moreover, the 
clocking mechanism "wraps around" so that the clocking region provides spatial information for data cells 
on both sides. 



It is important that the amount of clocking apparatus on the substrate be configurable. If there is too 
much, then density is lost due to the space occupied by the clocking mechanism itself If there is not enough, 
then spatial inaccuracies creep in, and this brings about cither erratic behavior, or loss in density if the spots 
must be made larger to accommodate the inaccuracies. Somewhere between there is an optimum amount of 
docking, and this amount may vary considerably from one combination of printer/scanner to another. 

The clocking is performed by markers, currently implemented as daric rectangles on a white vertical 
column. These markers capture both horizontal and vertical locaUon. The horizontal information is carried 
cssemially by counting the number of marker columns over, and multiplying that count by a determinable 
horizontal di^lacement between columns; the vertical infonnation is carried by counting the number of 
markers down, and multiplying thai count by a determinable vertical displacemem between markers. 

In principle the markers could be arranged in strips that run horizontally across the direction of 
the scan. Yet the distortions in a scanned image arc almost always in the vertical dimension, since this is 
governed by mechanical feciors of paper moving down a document feeder, or of a scan^tead^imiving down; 
It is more important therefore to keep track of the variations along the vertical dimension, which vcttical 
strips of markers more effectively do. (Of course it would be also possible in the current invention to have 
both horizontal and vertical strips, if significant distortions were introduced in both directions.) 
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Rather than have the markers the same size and periodicity as the spots — which a number of 
technologies do — it is far better to make their size and periodicity independent, since the role they play is 
quite different. 

5 The principle that must guide the dimensions and periodicity of the markers is that they roust be 

laid down by the printing process so that they rarely are absent, are clearly identifiable in the scan, and have 
absolutely reliable physical location. This is a general constraint on any clocking mechanism in any 
technology that encodes digital information on a substrate and decodes it by means of a scan. When the 
amount of overhead that the clocking mechanism incurs is decreased, by decreasing the cloddng features in 
1 0 size and/or frequency, the amount of data that can be affected by each imperfection (or aggregation of 
imperfections) in the printing or scaiming of the clodcing feamres increases. It is important therefore to be 
able to configure the clocking mechanism so as to minimize defects in the printing or scanning of the 
clocking features. The optimal configuration depends on the imperfections peculiar to the particular printer 
and scanner. 

15 

Considerable imperfection can be tolerated in data spots, since any individual defect can conq>cnsat6d for by 
error correction. Yet a single spatial inaccuracy arising from a marker can affect any number of rows of 
spots — u4uch-may-in turnconiprelgnd-pfflrtepshmMtn^ of 
data. In general, these constraints imply that markers should be larger than spots, and tettti separated from 
20 other features, including l>oth spots and each other. The absence of this capability in other technologies 
limits their ability to achieve highest densities and reliability. 

The concept of ** wrap around** in the current invention also^lays a key role, it means that the same 
set of guideposts that provides spatial information about a grouping of data cells on one side also provides it 
25 for a groiq>ing on the other. Alternative technologies which divide data into separated blocics demand not 
only a new, effectively redundant, set of guideposts ibr the nearby side of the neighboring block, but also a 
separation of white space (and perhaps other paraphernalia - e.g.. a thick t>ar), between the blocks so that the 
location of each block itself can be determined The unnecessary overhead all of this introduces can severely 
reduce the density of information on the substrate. 

30 

Other embodiments utilize maricers other than rectangular arrays of dark spots set in a light 
background. In one such embodiment, the maricers consist of a grouping of daric pixels in nonxectangolar 
shapes sudFasxnidesf^lipses^or-tranglesr in a finrthcr embodiment, markers consist of groupings of light 
pixels against a dark background. FIG. 4 illustrates this further embodiment. FIG. 4 contains an enlarged 
3 5 view of a portion of a datatile that is identical to that illustrated in FIG 4 except for the markers. Each 
column of markers 401 consists of a dark bar that preferably extends the entire length of the coiimm of 
markers 401 plus a few pixels on top and boUoro. The number of additional pixels on top and boaom would 
preferably be between one and two times the value for the format parameter Marker Height The bar would 
have a width that can preferably be varied by the person encoding data so that the user can optimize the 
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width for the particular printers aixl scanners anticipated or such other ciicumstances the user might 
ttKOumer. Thus, this embodiment would preferably have a Anther format parameter. Marker Bar Width. 
Similar t the datatile in FIG. 3, the horizontal distance from each marker to the nearest edges of possible 
spots is 6 pixels (i.e., the value for Marker to Spot equals 6). The dark bar for each column of markers 401 is 
5 8 pixels wide, consistent with a value of ft for Marker Bar WidtK Thus, the distance from the dark bar to the 
nearest edges of possible spots is 4 pixels. Within each dark bar are the markers themseh^ - arrays of white 
pixels that are 4 pixels wide and 3 pixels high. 

It is important for the technology to come to tenns with the basic fact that the defiited dimensions of 
10 a spot may be very different from the actual dimensions of the spot produced on a substrate by a printer. The 
precision of defined dimensions of a spot usually wdl exceeds the true precision of a printer When pushed 
close to their theoretical resolution, printers rarely can produce on a substrate a dark region filled in exactly 
to the bounds defined, and typically exceed and/or ^1 short of these bounds. One effect of this is that the 
notion of *^shape" of a spot largely breaks down. For example, at these resolutions, the defined squareness 
15 (or redanguiarity) of a spot is in great measure lost, and the spot becomes effectively a roughly circular (or 
oval) "^tob." It is likewise true that scarmers when pushed close to their resolutions cannot distinguish the 
shapes of even perfectly printed shapes on the substrate, and effectively reduce all small shapes to **blobs" 
which vary only in darkness and, to a degree, size. From the standpoitu of ability to encode data, the real 
issue becomes: in a given space, how many such ""blobs'" can be separately printed so that they can be 
20 distinguished by a scanner? For this reason, even if the defined shapes of these microscopic entities on the 
printed page differ from one case to another, it is, for the purposes of the technology, effectively the same 
representation. 

In the preferred embodiment, cells and spots are rectangular or essentially rectangular with the cells 
25 placed in horizontal rows and vertical columns in the datatile. In another embodiment, cells are formatted as 
diagonal spaces and series of cells are formatted diagonally into the datatile. In one embodiment spots are 
likewise formatted as nonrectangular spots. Formatting ^ts as nonrectangular shapes may be particularly 
advantageous where placing dots in all pixels of a rectangular spot results in too much ink spreading beyond 
the spot's theoretical limits (i.e., dot gain) while placing dots at less than all pixels (as might be accomplished 
30 with a nonrectangular spot shape) reduces the encroachment over a rectangular spot's borders while still 
giving good definition within the borders. 

In one embodiment, nonrectangular cells and ^x>ts are chosen through a dialog box that indudes an 
array of squares, each square representing a pixel. The person encoding data selects those squares in the 
35 array that represent a celt and within those squares, the squares that represent a spot Each of a plurality or 
all of the cells and spots in a datatile would have the shapes selected. FIG. 5 and FIG. 6 Illustrate dialog 
boxes according to this embodiment. FIG. 5 illustrates a dialog box for establishing the shapes for a spot and 
a cell. FIG. 6 illustrates a dialog box for determining how nonrectangular cell shapes fit together, and the 
sequence in which those cells are created and each bit in the series of digital data values is encoded. 

17 
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In FIG. 5, the user has 7 options, 5 represenlcd by radio buttons and 2 by icons. Matrix 50 1 
represents the printer pixels available for formatting spots and ceils, where each square in the matrix 
rq>rcscnts one printer pixeL The user selects Add to Spot, When this button is selected, the user moves the 
5 mouse cursor over desired squares in matrix 50 i aiKi clicks those squares. In FIG. 5, squares that have been 
selected as part of the spot are black. Pixel 502 illustrates a square that is pan of the spot If the user destics 
to revise pixels selected for the spot, the user selects Delete from Spot, moving the mouse cursor over 
previously selected squares and clicks, thereby removing those pixels from the spot (in an alternative dialog 
box, there is no sq>arate Delete from Spot and Delete from Cell radio buttons — clearing previous selections 

10 is instead performed done by clicking a second time on previously selected squares). The user also selects 
Add to Cell. When this button is selected, the user moves the mouse cursor over desired squares in inatrix 
501 and clicks those squares. In FIG. 5, squares that have been selected as part of the cell are those that 
either hatched or selected as part of a spot. Pixel 503 ilhistrates a square selected to be part of the cell but not 
part of the spot All squares not selected as part of either the spot or the cell remain blank. Square 504 

15 illustrates a square that is neither part of the spot nor the cell. The user selects Change Matrix Size if the 
user desires to either increase or decrease the array of printer pixels available for selection as part of the spot 
and cell. When the user completes the selection of spot and cell shapes, the user selects DONE or, if the user 
wishes to abortrthe sdectton-pnxess^ theiiser selfictsiC^i^^lGEL. 

20 In FIG. 6, the user has 3 options in addition to DONE and CANCEL (DONE and CANCEL have 

functions comparable to the similarly named icons in FIG. 5). Matrix 60 1 depicts the cell shape chosen in 
the CONnOURE SPOT/CELL SHAPE dialog box illustrated in FIG. 5. The CONFIGURE CELL 
PLACEMENT dialog box preferably pops up following completion of selection in the CONFIGURE 
SPOT/CELL SHAPE dialog box The cell previously selected is illustrated as area 602 - i.e., the area not 

25 composed of squares. Matrix 603 represents the printer pixels available for placing cells, where each square 
represents cme printer pixel. The user selects Add Another Square, moves the mouse cursor over area 602 
representing the cell shape, and leaving the mouse bonon clicked, moves (i.e., drags) an image of the cell 
shape to the desired location in matrix 603. Inappropriate selections are ignored by the computer in the 
dialog box, including selections that effectively change the shape of c^ls by leaving unfrHcd squares in gaps 

30 between cells of the chosen shape. The user selects Delete Cell to revise a previous selecdon (in an 

alternative dialog box the Delete Cell radio button does not exist and instead, the user clicks a second time on 
a previously placed cell). 

The user then selects Set Sequence, and moves the mouse cursor over cell shapes in matrix 603 in 
35 the order desired, clicking on each cell shape as the cursor moves. The sequence is indicated in the dialog 
box by the munerals in the cell shapes. The sequence selected determines the order in which bits from the 
series of digital data values are encoded in the cell, proceeding in the order seleaed to the border of the 
datasector then moving to the next line in the dalasector. In matrix 603, the order selected is a line of cells 
extending from upper left to lower right Cell shape 604 was selected as the first in the series followed by 
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cell shapes 605. 606, and 607. The roeUuxl f encoding would encode cells in this sequence starting at the 
left border of the datasector moving down and to the right to the other border of the datasector. Once the 
lower border has been reached, the sequence goes back to the first cell of the next line, d^icted in matrix 
603 as cell shape 608. This embodiment preferably determines a sequence of cells by default if none is 
5 selected by the user. One such de£ault sequence would generally follow the sequence of the preferred 
embodiment - i.e., generally from leit to right 

In the preferred embodiment the format parameters are selected through a combination of iiq)ut, 
automatic selection and default values. FIG. 7 describes this selection process as applied to each format 
10 parameter. The step of inputting, 701 , can encompass a user inputting a value for a format parameter. 

Inputting is performed using a keyboard, mouse, or other input device, to select values in a dialog box. After 
allowing adequate time for iiqmtting but before the method of encoding commences formatting, the selection 
process determines whether a value has in iaa been input, step 702. If a value has been input, the selection 
process sets the format parameter equal to that value, step 703. 

15 

If a value has not been input, the selection process then determines whether information otherwise 
available bears on the selection of a formal parameter value, step 704. For example, if the encoding process 
is being performed by a computer, the computer's operating system may have stored information in the 
printer driver concerning the default printer used by the computer. This information could include the 
20 printer's make, model, and resolution. Printer resolution can be particularly useful in automatic selection of 
format parameter values. Another source of information can be information input by the user other than 
values for the format parameters themselves. For example, the user can input infc^mation concerning the 
types and resolutions of printer and intended scanners for a given datatilc. While this information does not 
directly establish format parameter values (other than the Printer Type parameter which preferably does not 
25 directly influence the formatting process), the infbnnation dearly bears on the sdection of theses The 
correct setting for these parameters can be estaUished by experimentation with desired printers and scanners. 
The results of these experiments are then captured in lookup tables for the parameters that are stored in the 
sofUvare. Table 1 (included at the end of this Descripiion), provides values for format parameters for the 
most imponam combinations of off-the-shelf printers and scanners. In each case presented in Table I, Ink 
30 Colors is black and Ink Types is normal. 

If information is available, from whatever source, that bears on the selection of a format parameter 
value, then the selection process establishes the value consistent with that information, step 705. Otherwise, 
the selection process sets the format parameter equal to a predefined default value, step 706. The preferred 
default values are intended to be reliable no maner what printer or scaimer is used. 
35 While the selection process of the preferred embodiment provides for user input as at least one 

manner of selecting format parameters, other embodiments have other ways of selecting format parameters 
with no user input One such embodiment selects format parameter values as part of the process of 
developing computer code for the instructions to be executed by a computer and attached printer. In 
accordance with this embodiment, format parameter values are selected for a particular printer or set of 
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printers, where the values are preferably optimized for the particular printer or printers. It is therefore 
possible to include the selected format parameter values as part of printer drivers - i.e.. the set of computer 
instructions directing a particular printer to print and the manner in which to print In other embodiments, 
format parameter values are varied without user input by reference to information available without user 
5 input. In one such embodiment, the format parameter values are selected by reference to information known 
about attached printers, possible scanners, or a combination of such factors. 

FIG. S illustrates a digitally encoded substrate as produced by a preferred embodiment of the method 
of encoding. More particularly, the digitally encoded substrate illustrated in FIG. 8 consists of one datatile. 
It should be understood that the preferred embodiment produces one or a plurality of datatiles depending on 

10 the amount of digital data, the density of data produced by the formatting process, the size of the substrate 
and user preferences for dalatile size and quantity. The datatile in FIG. 8, enlarged for illustration purposes, 
consists of three main conqx>nents. a landmark 801, a roetasector 802, and a main body of data 803. 

In this embodiment^ tandmaik 801 consists of two bars - Le., two rectangular regions composed 
entirely of pixels in the same state. The landmark 801 consists of two bars that are eiuirely blade. One such 

1 5 rectangle is elongated vertically while the other is elongated horizontally. The basic purpose of these 
landmarks, as further described in the decoding process below, is twofold. 

First, the landmark provides information about the orientation of the pattern within the image, and 
in particular the orientation of the metasector. The mctasector atid;the: hnrT7nnffl it haT^ftherfaTOl i imik ar e 
both much longer than they are high. Furthermore, they are both designed to be printed at the same 

20 orientation - i.e., the horizontal aspects of each shouki be printed perfectly horizomal. The skew of the 
landmark in the scanned image ttwrefore gives a very good approximation of the skew of the metasector. 

Second, the landmark provides information about the scale of the pattern within the image, and the 
scale of the metasector in particular. In the preferred embodiment, the dimensions of the vertical bar and 
horizontal bar are standardized based on the sizes they assume when printed on a 300 dpi laser and 

25 configured for a 400 dpi scarmer — i.e., these settings are treated as the ^'base'* case. In particular, the 
vertical bar is printed with width of 6 printed pixels, and height of 32 printed pixels. The horizontal bar is 
printed with length of 64 pixels, and height of 16 pixels. These relative proportions are observed no matter 
what the resolution of a printer and scanner might be. If the pattern is to be scaimed in by a 300 dpi scanner, 
and printed on a 300 dpi laser, then the number of pixels is half again as much in each dimension (i.e., 

30 vertical bar 9 pixels wide by 48 pixels high, horizontal bar 96 pixels wide by 24 pixels high). And a 600 dpi 
laser will precisety double the number of pixels in each <timension for the two cases - i.e., for a 300 dpi 
scaimer the vertical bar is primed at 18 pixels wide by 96 pixels high and the horizontal bar is printed at 192 
pixels wide by 48 pixels high, wWle for a=400Mppscaimw^e vcrtrcal?baris^priracd atM2'ptxds wide by 64 
pixels high arul the horizontal bar is printed at 128 pixels wide by 32 pixels high. The vertical bar in 

35 landmark 401 has dimensions 9 pixels wide by 48 pixels high, while the horizontal bar has dimensions 96 
pixels wide by 24 pixels high. The scale can generally vary widely depending on the resolution of the printer 
and the scaxmer. 

In the preferred embodiment, the landmark is in precise scale to the metasector, which also has a 
rigid format. The width of the horizontal bar is precisely 16 times the width and 32 times the height of a 
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maiker in the cnetasector. Likewise, the dimensions in printer pixels of the meiasector itself will be a 
miiitiple of the ^'base" case printer pixels. Thus, the metasector*s markers, spots, and distances will, for 
example, precisely double if printed on a 600 dpi printer instead of a 300 dpi printer. The multiple used is 
encoded within the metasector. This allows a precise understanding of the ratio of printed pixels to image 
5 pixels. This understanding enables the algorithm to decode the data portion of the pattern, since distances 
and dimensions of markers and spots are defined in the metasector in terms of printed pixels 

In other embodiments, the method of encoding produces digitally encoded substrates with 
landmarks other than two bars consisting of pixels of the same state. Potential shapes for landmarks should 
be distinctive so that they are not easily confused with other possible features in the scanned image. They 
10 should also bear a predictable orientation with respect to the metasector, as well as a predictable scale (or 
limited set of scales.) 

In still further embodiments, the method of encoding produces digitally encoded substrates with no 
landmarks. In general, the laiulmarks perform a function that can be achieved through further 
computational steps. Such a process locates the left side of the printed pattern by exatmiting the image for 

15 horizontal sequences of white pixels followed to the right by dark pixels, and reconstructing the vertical left 
side for the pattern by assembling imo a straight line the points at which the dark pixels first occur. At the 
top of the left side of the pattern lies the metasector, and an algorithm locates the predictable number of 
ve^calmarken in the metasector (typically three) that occurs at the extreme left side. From the size and 
relative location of these markers, the orientation of the metasector as well as its scale can be well 

20 approximated Theknownpattern(oroncof a series of known patteriis) for the metasector markers virtually 
precludes mistaking some other gr^hical image as a metasector, thus allowing both a datatile and human 
readable graphics and text on the same page. 

Metasector S02 of the presem embodiment consists of two basic elements, metasector markers and 
metasector data cells. These two bask: elements are differentiated in the present embodiment by relative size 

25 and placement. Each metasector marker of metasector 802 is 3 pixels high by 6 pixels wide. These 

metasector markers are placed in groups of three, stacked vertically and separated from each other by 9 blank 
pixels. Metasector 802 contains 9 groups of three metasector markers, induding one group at the leftmost 
region of metasector 802 and one group at the rightnwst region of metasector 802. Each metasector data cell 
of metasector 802 is 6 pixels high by 6 pixels wide. These cells are grouped together between the groups of 

30 metasector markers, with any spots in the ceils closest to the metasector markers being 6 pixels liorizonlally 
removed from the metasector markers. The groups of metasector cells are 8 ceils wide by 5 cells high. Each 
cell within a group may contain a spot that is black or may be blank (white) depending on the bit value being 
encoded within ttiat cell. Each black spot in a metasector cell where called for, is 3 pixels wide by 3 pixels 
high. 

35 The data cell that may contain a spot is most perspicuously to be understood as locating such a spot 

precisely in its center. That is, if a spot is 3 pixels by 3 pixels, and its containing cell is 6 pixels tjy 6 pixels, 
then the border of that cdl should be understood as extending 1.5 pixels above, below, to the right of, and to 
the left of the spot Understanding the notion of a cell in this way allows all cells to be treated equally and 
symmetrically - in particular, the cells at the extreme right and extreme left of a contiguous aggregation of 
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cells are equally distant from the maricers at the border of the aggregation. While the notion that a spot is 
located precisely at the corresponding cell's center facilitates understanding of the construct of a cell, it 
should be further understood that the spot could be located anywhere in the array of pixels that defines a cell 
and achieve the same cfifect 
5 The importance of a notion of a cell from the point of view of understanding the invention is that a 

cell captures the separation of a potential spot from the neighboring potential spots. This separation is 
important to the invention, because, one, printed spots typically extend beyond their defined boundaries, and, 
two, when a daric spot is scanned, the darkness typically extends (beyond its physical bounds) into 
neighboring image pixels. These two phenomena demand that spots be defined with separation from each 

10 other if they, are to be most cflFcctivcly determined to be "on** or "oCf.'* Taking advantage of this can greatly 
increase the density of information on the page. 

The main body of data 803 of the present embodiment consists of two basic elements, markers and 
data cells. These two basic elements are differentiated in the present embodiment by relative size and 
placement Each marker is 3 pixels by 3 pixels, these dimensions having been determined by setting the 

15 parameters Marker Height and Marker Width each equal to 3 . The markers are arranged in colunms. with 
each column being one marker wide and as high as the main body of dau 803. The beginning of each 
marker within a column is separated vertically £rom the beginning of the next marker by 9 pixels, this 
distance being determined by (and is a pradnct nf)Hcerring^the pa ramfcter Cell-Height^egna i^tn-l^a^yHhr 
parameter Rows per Marker equal to 3. The main body of data 803 contains 10 columns of markers and 9 

20 groupings of data cells between those columns of markers. The 9 groupings of data cells across results from 
(and is a product of ) setting the parameter Datasectors Across equal to 3 and the parameter Data Segments 
equal to 3. The first three groupings for instance, located between columns of markers 804 and 80S, 
constitutes the first datasector (note Datasectors Down equals 1). Each grouping of data cells is 15 cells wide 
and extends the height of the main body of data 803. The number of cells across each grouping is 15 as a 

25 result of setting the parameter Spots per Segment equal to 15. Each grouping contains, in addidon to data 
cells, a calibration pattern such as calibration pattern 806. A calibration pattern contains spotted and blank 
cells arranged in a checkerboard pattera The calibrati<m patterns facilitate the decoding process by 
providing information on the darkness of the scanned image. Each data cell is 4 pixels wide by 3 pixds 
high, these dimensions having been determined by setting the parameter Cell Width equal to 4 and the 

30 parameter Cell Height equal to 3. Each data cell of the main body of data 803 contains either a black spot or 
is blank (white), depending on the bit value being encoded within that cell. Each black spot is 3 pbcels wide 
by 2 pixels high, these dimensions having been determined by setting the parameter Spot >^idth equal to 3 
and the parameter Spot Height equal to 2. The cotunm of markcrris^iw ri/omal ty -sepanite d from the closest 
possible spots in the data cells by 5 pixels, this distance having been determined by setting the parameter 

35 Marker to Spot equal to 5. The height of the main body of dau 803 is a function of the amount of data to 
encode, the parameter Datasecton Down, and the width of the main body of data 803, such width having 
been determined as indicated above. 

In a further embodiment of the method of encoding, information recorded on a substrate includes 
digital data as well as other information such as human readable text and graphics. FIG. 9 illustrates an 
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example of a substrate according to this cmbodimenL The substrate in FIG. 9 includes human readable text, 
graphics (i.e., a drawing of a cat's faocX and a datatilc containing digital data relevant to the human readable 
information (the daiatile in FIG. 9 iUustrates an embodiment that does not include a landmaik). The 
substrate illustrated in FIG. 9 thus conveys how a further embodiment of the invention can be used for such 
5 purposes as advertising, thus providing further evidctice of the invention's value. The invention's imique 
advantages (relative to other known technologies), including the ability to store far greater amounts of data in 
a limited space, the abiUty to determine locations of data through use of mctasectors, and the ability to 
determine cell locations by utilizing formattable series of markers, make the embodiment of FIG. 9 
commercially practical for the first time. In other embodiments, involving photographic materials and 
10 processes, encoded digital data is placed inside, alongside or on the back of images captured from normal 
photographic processes. In further embodiments involving digital photography, encoded digital data is 
placed inside, alongside or in bade of printouts of the digitally captured and recorded image, or inside, 
alongside or in back of printottts of scanned aikd digitized images captured from normal photographic 
processes. 

1 5 A further embodiment of the invention serves as a substitute for optical character recognition 

(^'OCR'*). The datatile in FIG. 9 could, for example, contain (whether or not in addition to the indicated list 
of information and phone ntmibers) the underlying file or files for the printed text and graphics. The datatile 
. i,.!.! r...ii.>. M »>u.»r^wwie in nnt pi^rfftrm ncu nn thi> printed text An embodiment that includes 
both (Xn^ capability and the ability to decode datatiles first attempts to fmd and decode a datatile. If 

20 successful in decoding a datatile (one that contains instructions not to perform OCR) the invention does not 
perform OCR cm the printed text but instead stores the file contained in the datatile. If no datatile is present 
on-a^irinled document (or if the datatile is not successfully decoded) this further embodiment performs OCR 
on the document The result in either case is a digital representation of the document. In light of current 
deficiencies in OCR, the first possibility - deriving a perfect digital representation from a datatile - is dearly 

25 preferable. 

While FIG. 9 includes human readable information in addition to digital data, it should be 
understood that further embodiments of the invention combine digital data as well as other infortnation that 
is not or is not primarily human rcad^^le through visual inspection. Thus, one further embodiment combines 
the encoded digital data with braille so that digital data can be transmitted by substrate to the visually 

30 impaired. For example, coaqxiter audio files can be transmitted on paper and the redpient can read the 
braille on the substrate to determine the contents of the computer audio files. In further embodiments, the 
machine read^le digital data produced by the present process is combined with machine readable digital 
data^-otfaer proce ss es such as those that utilize bar codes or charaaers wrinen in magnetic ink. These 
further embodiments allow existing installed bases of technologies to initially sort or otherwise make 

35 determinations tising existing equipmem and processes in place. 

In a further embodiment of the method of encoding, the digitally encoded substrate contains at least 
one datatile where parts of the datatile are kxated in noncontiguous regions of the substrate instead of the 
whole datatile being located in one region of the substrate. The regions not occupied by parts of the datatile 
may contain other printable matter iiKiuding human readable text or graphics, blat)k space, or parts <x alt of 
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other datatiles. FIG. 10 iUustrates an example of a substrate produced in accordance ^vith this embodiment. 
This substrate contains parts of a single datatile, a landmark S01» a metaseaor H02, and a main body of data 
1003. The substrate also contains human readable text 1004. Parts of the daiatile are in noncontiguous 
regions of the substrate. Landmark $01 and metasector 802 are located together at the top of the substrate. 
5 Main body of data 1003 is divided into 2 parts, each of which is physically separate from each other and torn 
landmark 801 and metasectOT 802. Human readable text 1004 occupies space between the noncontiguous 
parts of the datatile. 

In one embodiment of the method of encoding, the metasector contains information indicating or 
otherwise assisting in the determination of the location of the various paru of the main body of data 1003 

10 while in a further embodiment, a part or parts of the main body of data 1003 contains information indicating 
or otherwise assisting in the detemunation of the location of the other parts of the main body of data 1003, 
while in a still further embodiment, the various parts of the main body of data 1003 are located without 
reference to information provided by either metasector 802 or other parts of the main bod|y of data 1003. Of 
these various embodiments, the preferred method places in the metasector the location information for at 

15 least the first grouping of cells of the main body of data. If less than all location information is placed in the 
metasector, the preferred method would place in the main body of data's first grouping of cells the location 
information for at least the next groi4)ing of cdls. Determination of the landmark and metasector locations 
therefore iadlitates determination of locations of a series of 0on<ontiguoiB;!parts of^thermain body of ^data. 
Location of cells within non-contiguous parts of the main body of data is aided by another aspect of the 

20 invention - i.e., the intermittent series of fonnattable markets. In some embodiments, the number and size of 
the separate parts of the main body of data 1003 are fixed by information contained in metasector 802 or 
other parts of the main body of data 1003. In other embodiments, the number and/or size of the separate 
parts of the main body of data 1003 are not fixed. The method of decoding continues searching for 
additional parts until no more are found, either because the entire substrate has been searched or because the 

25 succession of location refer e nces ftom part to stibsequent part ceases. 

While the result of the method of encoding is sometimes a single digitally encoded substrate, in 
some instances the preferred embodiment produces a plurality of digitally encoded substrates from one or 
more computer files or series of digital data values. Utilization of multiple substrates may be called for 
particularly when the amount of data or the size of one or more computer files exceeds the limits of what can 

30 be encoded on a single substrate. Thus, computer files or other digital data of virtually unlimited sizes can be 
encoded 

In a further embodiment, a plurality of datatiles are encoded onto a single digitally encoded 
substrate. The encoding into multiple datatiles may be particularly called forto fiicilttate'in the navigation 
to particular digital data. For example, a newspaper page might contain several articles with a separate 
35 datatile alongside each article with digital data (such as a digital representation of the article itself) relevant 
to the particular article. Multiple datatiles on one substrate may also be used such that each is decoded in 
sequence in order to provide a steady stream of data once the first datatile is decoded instead of waiting for 
an entire page to be decoded. In some embodiments this steady stream of data is used for some further 
application, where the computer decodes datatiles and executes this further application on such a 
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substantially contemporaneous basis as to be transparent to the user. In one such embodiment, the method of 
decoding is imegrated with application software that displays video clips and plays audio files such that 
datatiles are decoded, video displayed, and audio played on a substantially contemporaneous basis. 

FIG. 1 1 illustrates a digitally encoded n^>straie containing multiple datatiles, each originally 
5 produced by the preferred embodiment of the invention and then enlarged 250% in each dimension for 
illustration purposes. The first two datatiles, 1 101 and 1 102, were intended to be decoded by using a fax 
machine as a scanner. The third datatile, 1 103, was intended to be decoded by using a flatbed scanner with 
an optical resolution of no less than 300 dpi scanning 256 levels of gray scale. Datatiles 1 101 and 1 102 are 
two datatiles that togetiier contain one computer file. Datatile 1 103 contains one whole computer file. The 
10 one computer file contained in datatiles 1 101 and 1102 contains 1.866 bytes of text while tiie one computer 
file contained in datatile 1103 contains 3,112 bytes of text. While a flatbed 300 dpi scaimer can successfiiUy 
decode the originals (i.e., at tiidr original size) of all Uiree datatiles, 1 101, 1 102, and 1 103, using a fax 
machine as a scanner, the invention can successfully decode only datatiles 1 101 and 1 102 (at their original 
size). Thus, FIG. 1 1 illustrates another feature of the invention - the ability to convey^ base amount of data 
15 to all recipients regardless of their scanners* capabilities by fonnatling at least one datatile using the lowest 
common denominator while providing significantly more data to those with more powerful scanners. 

FIG. 12 illustrates a digitally encoded substrate containing multiple datatiles, all produced by the 
pnJa n al ?«nhodimfirtr'nfr Hr iii w a fitan , all d e pic ted at their actual, original size. The first two datatiles, 
1201 and 1202, arc intended to be decoded by using a iax machine as a scanner. The third datatile, 1203, is 
20 intended to be decoded by using a flatbed scanner with an optical resolution of no less than 300 dpi scanning 
256 levels of gray scale. Dautiles 1201 and 1202 arc two datatiles Utat togetiier contain one computer file. 
Datatile 1203 contains onr whole ctmipater file. The one computer file contained in datatiles 1201 and 1202 
contains 28,371 bytes of text while the one computer file contained in datatile 1203 contains 48,102 bytes of 
text. 

The method of encoding of the preferred embodiment is capable of producing multiple datatiles (or 
series of datatiles) each of which contains tiie identical file or files and are distinguished from each otiier by 
their unique identification tag. This capability allows each datatile to contain a unique password, for 
example, while rainimizing the amount of computing necessary to format each datatile. Each of the 
fonnattcd patterns represented by the datatiles are preferably identical to each other except for that part of the 

30 pattern e)q)ressing the unique identification tag. In this fashion, a owltiplicity of datatiles conveying the 
same data can be formatted using as a template a pattern containing everything but the identification tag and, 
for each datatile. completing the datatile by adding to the template a second (and much smaller) pattern 
rqneseming-the identification tag. In the preferred embodiment, the identification tag is added to the main 
body of data at the end (i.e., in Uie lower right comer of tiic datatile, following the file or files intended to be 

35 conveyed). In a fiirther embodiment, the identification tag is added to tiie metasector - one grouping of 
metascctor cells 8 cells wide by 5 cells high is capable of expressing 2^ unique identifications. In still 
further embodiments, the identification tag is a pattern near but not witiiin the metasector or main body of 
data of tiie datatile. This last embodiment fecilitates first photocopying tiie template pattern tiien adding tiie 
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tdcntificauon tag in a second step. Because the idemificaiion tag is not part of the metascctor or main body 
of data of the datatile. the embodiment is more tolerant of any misregistration caused by outputting in 2 steps. 

One embodiment would expiess different logical states for each cell by the placement of spots with 
different attributes. I>epeiuiing on the embodiment the attributes that could vary to express different logical 
S states include spot size, spot color, ink type, and spot shape. In one such embodiment, illustrated in FIG. 13, 
each cell contains a ^t. Each spot has one of two sizes. Markers 301, bordering the data cells, are 4 pixels 
wide by 3 pixels high. Each data cell contains one bit of information expressed by two logical states. A first 
logical state, exemplified by spot 1302, is expressed by a spot 3 pixels wide by 3 pixels high. A second 
logical state, exemplified by spot 1303, is expressed by a spot 1 pixel wide by 1 pixel high. In this fashion, 

10 each cell contains a spot of one of the two sizes. In instances where a self-clocking mechanism is called for, 
this ^nbodiment would have the advantage of providing such a mechanism. 

In a further embodiment, each cell represents more than one bit where a plurality of bits are 
expressed by spots of different sizes and colors. FIG. 14 is an enlarged view of a substrate produced by such 
an embodiment containing markers 301 and ceils 1402, 1403, J404, 140S, 1406, 1407, 1408, and 1409. 

15 Markers 301 are of uniform size, 4 pixels wide by 3 pixels high, and color, black. FIG. 14 contains cells 
each of which represents 3 bits in a series of digital data values. Each cell has one of eight different logical 
states with one logical state expressed by the absence of a spot and each of the other logical states expressed 
by a spot with either a size or color different from a spot expressing any other Icgical^tate. 0^-1402 
contains a black spot 3 pixels wide by 3 pixels high. Cell 1403 contains a black spot 2 pixels wide by 2 

20 pixels high. Cell 1404 contains a black spot 1 pixel wide by 1 pixel high. Cell 1405 is blank. Cell 1406 
contains a gray spot 3 pixels wide by 3 pixels high. Cell 1407 contains a gray spot 2 pixels wide by 2 pixels 
high. Cell 1408 contains a gray spot 1 pixel wide by I pixel high. Cell 1409 contains a black spot I pixel 
wide by 1 pixel high surrounded by a gray border 1 pixel wide on all sides. Hence, cells 1402, 1403, 1404, 
1405, 1406, 1407, 1408, and 1409 are examples of each of the eight different logical states that a cell can 

25 express. 

FIG. 15 illustrates the use of more than one cell size in the same datatile. A user of the invention 
may desire to select such a configuration when, for example, one cell size is too small and the next larger cell 
size wastes space. If a user determines that dot gain prevents a smaller cell size from accurately conveying 
data, this embodiment allows the user to alternate cell sizes between a smaller size and the next larger size to 

30 overcome the problem while making the most efficient use of space. It is a reasonable inference that the 
technique of different cell sizes can increase the density of informatiotL Any spot either within a larger cell, 
or within a smaller cell contiguous to a larger cell, will enjoy greater separation from at least one 
neighboring spot than it would if all spots were within smaller cells. This will serve to rediioe'th&bit errors 
that will be introduced in decoding, since the number of bit errors depends critically on the separation. The 

35 reduction of bit enors in turn can allow the correct decoding of the information in cases in which it would be 
impossible if all cells were of the smaller size. 

FIG. 15 references markers 301, and spots 1502, 1503, 1504, and 1505. The elements in FIG. 15 
are enlarged for purposes of illustration and explanation. While spots are considered in FIG 15 to occupy the 
upper left comers of cells for illustration purposes, it should be understood that this is just one possible 
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embodiment - another embodiment, for example, places a spot in the center of cells. Markers 301 are 4 
pixels wide by 3 pixels high. Each of the spots is 3 pixels wide by 3 pixels high. The first column is 
f rmatted to mcludc cells that are 3 pixels wide and 4 pixels high and, accordingly, spots 1502 and 1503 are 
in cells 3 pixels wide and 4 pixels high. The second column is formatted to include cells that are 4 pixels 
5 wide by 4 pixels high and, accordingly, spot 1504 is in a cell 4 pixels wide by 4 pixels high. Because the first 
column has been formatted such that its width equals the width of any spot, a spot in the first column directly 
adjoins a spot in the same row in the second column, as illustrated by spots 1503 and 1504, which together 
appear to be one spot twice as wide as high, but are in £ict two distinct spots. Because the second column has 
been formatted to be wider than any spot, any spots in the same row in the third cohmm will not directly 
10 adjoin spots in the second column. Accordingly, spot 1504 does not directly adjoin spot 1505. 

DECODING 

Formatted digital data produced fay the invention most be decoded in order to reconstruct the 
original computer files or other digital data. The manner in which the preferred embodiment accomplishes 

15 the decoding is illustrated in FIGS. 16, 17, 18, and 19. FIGS. 16, 17, and IS are block diagrams describing 
processes relating to decoding, while FIG. 19 is an enlarged portion of a digitally encoded substrate used to 
illustrate the steps diagrammed in FIG. 18. FIG. 16 describes the method of decoding • i.e., the broad 
perspectivc^of-how^asdigitall^^enoortnt-CThstr^ in the steps according to this broad 

perspective is step 1602, the decoding process. FIG. 17 describes the preferred embodiment of the decoding 

20 im)cess. Included in the steps according to this preferred embodiment are steps 1704 and 1706, both of 
which involve decoding a grouping of ocmtiguous cells. Decoding a grouping of contiguous cells involves a 
process of recovering digital data values from the grouping. FIG. 18 is a block diagram describing the 
preferred embodiment ofthat recovery process. Thus, FIG. 16, 17, and 18 should be understood as 
illustrating increasing detail of the manner in which the preferred embodiment reconstructs the original 

25 computer files or other digital data. 

The overall method of decoding a substrate con^>rises, at a minimum, the steps of scaiuiing (i.e., 
creating an electronic image of the substrate) and decoding. In the preferred embodiment, the method of 
decoding further comprises the steps of error correction, error detection, and decompressioiL This 
embodiment is illustrated in FIG. 16. The digitally encoded substrate is first scanned (processing block 

30 1601). In a prefened embodiment, this scanning occurs using a flatbed scarmer attached to a personal 

computer. In further embodiments, the scanning occurs using a handheld scanner, a sheet-fed page scanner, 
a business card scarmer, a drum scanner or another type of scanner attached to a personal computer. It 
should^tg un da s lu o d that the un iver se of sc aim ers which may be used is not limited to those attached to 
personal computers but could include any scanner capable of producing an electronic image. In a still further 

35 embodiment, a facsimile machine is used as a scanner, whereby a digitally encoded substrate is fed through 
the facsimile machine to produce a scan of the datatile. The fax machine may connect to the computer 
through telephone lines (i.e., by the normal process of transmitting a facsimile from one facsimile device to 
another by causing the facsimile machine to place a telephone call to a fax/modem attached to the computer), 
through a device connected to both the facsimile machine and the fax/modem (connected to the computer) 
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which simulates a telephone line^ or directly by a telephone wire connected t both the £icsimile inachiae and 
a fax/modem which is connected to the computer. The result of the scanning is an image of the digitally 
encoded substrate, such image residing in the memory, fixed drive or other storage component f the 
personal computer The image is preferably stored as a bitmap image. Note that the stored image only 
5 approximates the pattern placed on the digitally encoded substrate produced by the encoding process. Errors 
produced by the scanning process, such as misregistration, artifacts due to crimps and folds, skew, and 
scanner defects, may prevent the stored image from exactly representing the digitally encoded substrate. 

The stored image is then decoded (processing block 1602). The decoding process identifies ceils 
(i.e., the locations of possible spots) in the stored image and determines for each cell, at a minimum, the 

1 0 presence or absence of a spot. The aggregation of these determinations results in a series of digital data 
values. Further embodiments make additional determinations that may include the color and size of a spot 
present, if any. These further embodiments depend on embodiments of the encoding process that provide for 
encoding of spots that vary in color or size. The result of these further embodiments is likewise a series of 
digital data values, but each cell represents more than one bit of that series of digital vaTues. 

1 5 The series of digital data values resulting from decoding process 1602 is then subjeaed to error 

correction and detection processing (processing block 1603). This step 1603 is the inverse of the error 
correction encoding which occurred during encoding (FIG. 2). The error detection and correction occurs by 
using the codewords with redundant parity bits added during encoding (FIG. 2) to correct errors which may 
have occurred. The error correction compensates for the loss of data due to damage to the paper or due to the 
20 failure to predia the cell location correctly. The errors may be attributed to staples, hole punches, folds, 
crumples, paper discolorations. technical problems, imperfections inuroduced in the scanning process or other 
imperfections. 

Once any required error correction is performed, the stream of digital data values is decompressed 
(processing block 1604). The decompression peifonned depends on the con^ression performed during 
25 encoding and is performed to restore the data to its original form. 

After decoding (processing block 1602), error detection and correction (processing block 1603) and 
decompression (processing block 1604), the reconstrxicted computer files or other digital data can be stored 
on a disk, displayed, or otherwise used by the computer doing the decoding. 

Decoding process 1602 of the preferred embodiment of the invention (FIG. S, described above, 
30 illustrates a digitally encoded substrate produced by the preferred embodiment) takes advantage of the wealth 
of information provided in the encoding process. Decoding process 1602 of this preferred embodiment 
achieves a pyramid gain of knowledge: finding the landmark conveys knowledge on where to find the 
metasector, as well as its dimensions, the mctaseaor conveys knowledge on where to find the main body of 
data and how precisely to extract data from that main body of data, and the main body of data conveys the 
35 underlying computer files or other digital data. 

While the method of decoding is described above by reference to a single datatile, the preferred 
embodiment allows the same steps to be applied to each of a series of datatiles. In one such instance, 
multiple substrates contain, in the aggregate, more than one datatile while in a further instance, a single 
substrate contains multiple datatiles, as illustrated in FIG. 1 1 and FIG. 12. The method of decoding of the 
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preferred embodiment applied to multiple datatiles first scans all datatiles and then applies all of the 
remaining steps (1602, 1603, and 1604) to each datatile before proceeding to the next datatile. Another 
embodiment applies all of the steps of FIG. 16 to each datatile before proceeding t the next datatile. A 
further embodiment applies each step to all datatiles before proceeding to the next step. With each 
3 possibility, an automatic document feeder attached to a scaimer facilitates the creation of images which are 
then subject to the decoding process. It should be understood that the method of decoding can also be applied 
to multiple datatiles not encoded on substrates but, instead, are always in electronic form, as in the case of a 
facsimile transmission of datatiles from a fax/modem to a fix/modem. 

FIG. 17 illustrates the decoding process achieving a pyramid gain of knowledge according to the 
10 preferred embodiment. The process may be generally described as one in which the locations of metasector 
cells are determined, the information in the metasector cells is derived, the locations of cells in the main body 
of data are determined and the data in the cells of the main body of data is derived. The steps of determining 
the locations of cells in the main body of data and deriving the data from those cells is performed by using 
the information conveyed by the metasector cells. In the case of multiple datatiles forming one sehes of 
1 S digital data values, the entire sequence of steps of FIG. 17 are preferably applied to one datatile before 
proceeding to the next datatile. 

First, the decoding process fimls the landmark (processing block 1701). In a digitally encoded 
s u hsf ra te pmdiiced by the pnafimedt m gm g described above), 

this landmark consists of two dark bars located at the upper left comer of the datatile, with the first dark bar 
20 having a height significantly greater than its width and a second dark bar located near the first dark bar with 
the second daric bar having a width significantly greater than its height The decoding process can find the 
two bars due to their unique characteristics. The decoding process looks for a series of comiguous dark 
pixels. Having found such a series of contiguous dark pixels, the decoding process tests whether a series of 
contiguous dark pixels of a calculated number extends in the orthogonal direction, with the calculated 
23 number determined by reference to the lumiber of pixels extending in the first direction and the predefined 
ratios of width to height. The decoding process then attempts to determine the orientation of the fint bar - 
i.e., whether the image has been skewed resulting in the first bar being skewed. Determination of orientation 
is accomplished by locating the comers of the first bar and judging skew by the relative location of these 
comers. Location of the comers of what might be a first bar further aids determination of whether the first 
30 bar has in fact been found. The comers of the first bar should be a certain angle and distance in pixels from 
each other. If the decoding process locates the appropriate angle and distance in pixels between comers, the 
decoding process assumes for purposes of further testing that it has found a first bar of the landmark. The 
dcwidingigDcess^thei^d et e fTT ri n es'whetber^a^sccoiidigrexi^^ to the 

first bar. Existence of a second bar is accomplished by likewise locating a calculated number of consecutive 
35 dark pixels extending in one direction, and a second calculated number of dark pixels extending in the other 
direction, with the calculated numbers of pixels in each direcUon determined by reference to the size of the 
first bar and the predefined ratios of heights and widths. It should be understood that while the process 
described assumes certainty in the relative size and location of the bars comprising the landmark, the 
preferred embodiment allows for some latitude. The degree of latitude involves a tradeoff, with too much 
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flexibility introducing the possibility of the decoding process concluding that it has found a landmark, where 
none in fact exists, and too little flexibility forcing the conclusion that it can find no landmark, where a 
landmark in fact exists. Any person skilled in the art would be able to determine an appropriate degree of 
flexibility. It should be further understood that in other embodiments of the invention, landmarks of a 
5 different size, shape or appearance are used, or no landmark at all is used. In each of these further 
embodiments, the steps described above are modified or omitted. 

The next step toward knowledge acquisition comprises locating the metasector (processing block 
1702). As illustrated in FIG. 8, described more fully above, the metasector of the preferred embodiment is 
located at a predefined location relative to Uie landmark, thai location being generally to the right of the 
10 landmark. Having already located the landmark, processing block 170 1, the decoding process knows where 
the metasector should be in the image of the digitally encoded substrate. The decoding process determines the 
distance of the metasector from what it knows about the landmark. Once it determines the width and height 
of the landmark's horizontal and vertical bars in image pixels, it can calculate the ratio of image pixels to 
printed pixels in the "base*" case described earlier by reference to FIG. 8. This allows it to calculate the 
15 displacement in inimber of image pixels of the first column of metasector markers firom the landmark, for the 
other colunms of markers in the metasector, and the expected size and distances, in image pixels, of these 
markers and of the spots. The decoding process firuls the metasector by finding the first column of 
roetasector markers based on what is known about the location of the landmark in the image, the relative 
location of the metasector to the landmark in printed pixels and the ratio of image pixels to printed pixels. 
20 The decoding process preferably allows some degree of latitude in making this determination of location and 
dimensions. 

Having found the metasector (processing block 1702) the decoding process then finds the metasector 
markers, processing block 1703. In the preferred embodiment (as illustrated in FIG. 8 described above) tiie 
metasector includes 27 metasector markers, 9 columns of 3 evenly spaced markers, with one column of 

25 markers bordering each of the left and right sides of the metasector. In addition to having predefined 

locations, the metasector markers of the preferred embodiment have a size predefined to be different from the 
metasector data spots. The decoding process determines where the metasector markers should be and then 
confirms those locations or adjusu to the actual locations as necessary. Because the number of metasector 
markers arul the number of cells between these markers is fixed in the preferred embodiment this 

30 determination is straightforward (as described more fully below with reference to FIG. 18). 

Another embodiment of the invention provides for an abbreviated metasector, such an abbreviated 
n^tasector being warranted when, for example, customary practice of consumers limits the variety ai formats 
actually used. The metasector format in the preferred embodiment expresses enough information to allow the 
main body of data to assume a vast variety of formats. Yet after considerable experimentation by consumers, 

35 it may be that only a relatively small number of such formats enters widespread use. These formats may be 
adequately captured by a much abbreviated metasector, that only permits these commonly used formats to be 
specified. 

In a further embodiment there are a finite number of possible formats for the metasector. Each of 
these is searched for, until one is found that conforms to a known possibility. This can be safely done, since 
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it will be ceitain whether the metasector has been correctly interpreted. Each metasector bas a checksum 
asscx:iated with it that can guarantee, to any specified level of certainty, that the information decoded is 
wholly correct And f course the metasector might also be in the form of a staiidard linear barcode, with its 
own notion of error detection. 
5 It is likewise true that the main body of data might have a ftnite number of expected formats, which 

are the most coixunonly used fonnais, aiKl even in the absence of a metasector, could be correctly decoded 
simply by cycling through the possibilities until one is found that works. The correctness of the choice would 
again be assured by a checksum in the main body of data. 

The decoding process then decodes the dau contained in the metasector (processing block 1704). 
10 such information being located in cells in between the metasector markers. The preferred method of 
decoding the metasector is as Ulustrated in FIG. 18, described below. The result of the decoding process is 
primarily information relating to the encoding process. The decoding process uses this information to 
decode the main body of data (processing block 1706). The metasector can also contain information not 
used in the decoding process, such as the time and date the datatile was created. This Information, as wcH as 
15 other information not directly related to the decoding, can likewise be contained in the main body of data. 

Tlic penultimate step in knowledge acquisition involves locating the main body of data, processing 
block 1705. As Ulustrated in FIG. 8 described above, a prcfcned embodiment places the main botty of data at 
a predefined l ocarinn r ptl att ve to tha landmark aTiH^t»>m^ta«.»^- Th,>rf^r^.rf«^p,.y,, ... 
embodiment searches for a first maricer of the main body of data at or near this predeftoed locaUon in the 
20 image of the digitally encoded substrate. 

The final step in knowledge acquisition is decoding the main body of data, processing block 1 706, 
The decoding process preferably accomplishes this by employing the same basic process used^ decode the 
metasector, as ilhistrated in FIG. 18. The mechanics differ primarily to reflect the peculiarities of the main 
body of data relative to the metasector. In particular, the mechanics of decoding the main body of data take 
25 advantage ofthe wealth ofinformation provided in the metasector. While the metasector has preferably been 
encoded in a rigid or semi-rigid fuhion with each metasector having the same or largely the same format as 
any other metasector produced by the method of encoding, the main body of data is preferably encoded in a 
user selectable format which can vary widely. For example, while every metasector is preferably encoded 
with cells of a constant or largely constam kiw resolution, the main body of data may be encoded with cells 
30 whose size can vary greatly among datatiles. The mechanics of the decoding process for the main body of 
knowledge consideiB the flcjdbiiilyaUowcd by the method of encoding, with the detaiU ofthe encoding 
process contained in the metasector and communicated by the pyramid gain of knowledge approach ofthe 
preferred embodiment: 13icanannet^whacfatthetdB codii^^prix«ss uses ih es^ is flhistrated in RG. 
19, and discussed below. 

3^ Tlw m et a sec to r, when present, should generally contain at least the version number, the multiple of 

the •n^se" printed dimensions of the landmark and metasector, the width and height ofthe markers, Uie 
number of rows of spots per marker, the distance between markers and spots, the horizontal distance between 
spots (Lc, the difference between Cell Wklth and Spot Width), the distance between rows of spots (Le., the 
difference between Cell Height and Spot Height), the width and height of the spots, the type of checksum in 
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the data sectors, the type of printer (e.g., laser or tnkjet), the type and degree of error conrectioii, and finally a 
checksum to guarantee the correctness of the information. In the preferred embodiment the metasector 
contains, in addition to the above information, the number of data segments per datasector, the number of 
datasectors down, the number of datasectors across, and the size of the data contained in the data portion of 
S the pattern. However, in auother embodiment this additional data is instead placed in the main body of data 
of the pattern by placing it in the top rows of the first portion of the main body of data. 

The version of the metasector indicates the precise format and nature of the data fields contained 
within the metasector. It may also be used to indicate peculiarities of the format of the main body of data of 
the pattern - for example, the size of the header information in the main body of data. 

10 The result of the decoding process is a series of digital data values. This series of digital data values 

is the ui^)n)cessed data stream from which the method of decoding derives the original computer files or 
other digital data after aj^ying decompression and, possibly, decryption processing. 

The basic process for recovering data fh>m cells is preferably the same whether the cells art 
contained in the metasector or in the main body of data. FIG. 18 illustrates this recovery'process as applied 

15 to an image of a digitally encoded substrate produced by a preferred embodiment of the invention, an 
example of which is illustrated in FIG 8. The recovery process sequentially finds the point in each cell 
representing the center of where a spot might be printed and for each cell determines whether a spot exists at 
thateloe^itir-^hNte^feai^cp, ^Kocessing blodc 1801, the recovery process locates the first marker in the 
image of the metasector or the main body of data, as the case may be. The recovery process then locates the 

20 center at that first marker, processing block 1802. The recovery process then locates the center of the nearest 
marker displaced horizontally, preferably the marker to the immediate right, and the nearest marker 
displaced verttcaUy, preferably the marker inunediately down fiom the first marker, processing block 1803. 
Themarken are fbimd by first locating the topnu>$t, leftmost marker. This is done by examining the region 
where the marker is expected, looking through vertical strips of pixels fiom right to left until all the vertical 

25 strips are **white.** This will deterrnitie where the leftinost dark pixels in the tnaricer axe. Next, horizontal 
strips are examined from bottom to top. noting where all the strips turn white. This determines where the 
topmost dark pbcels in the marker are. The precise center of the marker is then determined by finding all the 
contiguous dark pixels, and finding (he centroid of this group of pixels. Once the top left marker is found, 
the top marker for the next column is determined in the preferred embodiment by moving the known 

30 displacement across the image, and finding the precise top of the marker by repeating the process descritied 
for iiiuliiig the top of the top, left marker. Again, the precise cemer is found by finding the centroid of the 
contiguous dark pixels. The markers down the colunm are found by the preferred embodiment by 
progressing down the image from a previously determined marker, examinin). ontal strips of pixels, and 
detecting when the combined intensities of the pixels in the strip dips signifies as is characteristic when 

35 a new marker is encountered. In another embodimeiU, markers down are determined by first moving down a 
known displacement to determine the approximate location of the next marker, then searching for the 
centroid pixel of the marker. 

The recovery process then determines for each cell in between the first marker and the next nearest 
markers displaced vertically and horizontally the point in the cell representing the center of where a spot 
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might be printed. The centers of spot locations are determined by locating the lines across the centers of the 
rows where spots might be printed in between the first marker and the next marker displaced vertically, 
processing block 1804, and then locating the lines down the centers of the columns where spots might be 
printed in between the first marker and the next marker displaced horizontally, processing block 1805. Each 
5 spot is preferaUy thought of as occupyiiig the precise center of its correspoiuting cell. Accordingly, 
determining the lines across the centers of rows where spots might be printed equates to finding the lines 
through the centers of rows of cells. Likewise, determining lines down the centers of the columns where 
spots might be printed equates to finding the lines through the centers of columns of cells. 

Having found the centers of possible spot locations in between the first marker and the next nearest 
1 0 markers, the recovery process determines whether each cell is "on" or "oflT by determining whether a spot is 
present or absent at each of the possible spot locations, and accumulates these determinations. The recovery 
process accomplishes this subprocess by looping through a series of steps for each cell; processing block 1806 
establishes the loop for each cell. For each cell, the recovery process determines whether a spot exists at the 
point representing the center of where a spot would be if printed, processing block 1807. The center is 
1 5 determined as the intersection of the central line through the column and the central line through the row 
containing any such spot It should be understood that the preferred embodiment makes more than a simple 
*'yes" or "no" determination of whether a spot exists at a particular pixel. The preferred embodiment 
determines the level of gr^scale of the-centerpixel-and, rii Tw irfin g ^ miithfcgiaj m i rfff ifwjv i<rv - T^nA 
the cell contains a spot, determines th^ the cell does not contain a spot, or determines the need for further 
20 processing if it is too close to call If it is too close to call, information about whether surrounding dots or 
spots are present or absent may be used to settle whether the spot is to be considered on or off. If surrounding 
the region of a potential spot, the neighboring potential spots appear to be mostly present, the intensity of the 
region of the potential spot is generally depressed (i.e.. darker). This is compensated for in the preferred 
embodiment by adding predetermined values to the intensity found in the region of the potential spot (i.e.. 
25 the invention assumes that the region of the poterttial spot is lighter than what was actually found in the 
image). If a spot is determined to be present in the cell the recovery process starts (or, in subsequent 
iterations, adds to) a series of digital data values with a value of 1. processing block 1808. If, alternatively, a 
spot is detcrmiiied to be absent from the cell, the recovery process starts (or, in subsequent iterations, adds to) 
a series of digital data values with a vakie of 0, processing block 1809. 
30 The next step, processing block 1810, determines whether to contiime the toop. If all cells between 

the first marker and the next nearest markers have been tested for spots, the recovery process proceeds to 
processing block 1811. If cells remain to be tested for spots, the recovery process returns to the begirming of 
the loop at 1806. reiterating steps l8Q7^tfarough-1810 T f o r^e achtc ell. 

For each further marker or set of markers, the recovery process repeats the process described and 
35 illustrated in steps 1801 through 18 10. The recovery process first determines whether an additional marker 
exists, processing block 18 U. The recovery process determines this by calculating the number of markers 
encountered, and comparing this number with the number of markers expected. The number of markers 
expected by the preferred embodiment is based on a calculation derived from the number of datasectors 
down, the number across, the number of spots across a single row in a single datasector, the nimiber of rows 
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of spots per marker and the total size of the information in the printed pattern. If an additional maricer 
exists, additional cells with data need processing to recover their data. The recovery process is repeated by 
first treating an adjacent marker as the primary marker of reference (described above as the first maiker), 
processing block 1S12» and then repeating 5tq>s 1801 through 1811. The preferable manner of choosing an 
5 adjacent marker is systematically. A preferred embodiment recovers an entire datasector before moving on to 
the next datasector. A row of datasectors (i.e., all datascctors across a datatile) arc recovered before moving 
to the next row of datasectors. Within a datasector, the markers are chosen in a similar fashion - markers are 
sequentially chosen across an entire row, with rows sequentially chosen down the datasector. 

In the preferred embodiment, all datasectors within a datatile are decoded in order to recover all 
10 data encoded in thai datatile. In another embodiment, less than all datasectors are decoded. This further 
embodiment might be preferable when, for example, a particular application requires some, but not all data 
conveyed in a datatile and the datatile is designed such that data is encoded in a predetermined organized 
fiishion and the particular application accesses particular dataseaors to seek particular data. Such an 
embodiment would save time and computational resources relative to decoding the entire datatile. Such an 
15 embodiment can also be employed to supply a steady stream of data to an application such that datasectors 
arc decoded and the application software is executed both on such a substantially contemporaneous basis as 
to be transparent to the user (e.g., where the application software is a video player, the video player displays a 
ooni i n u oiis^stTrmn-fff r viihi u dui iw ed^feM4he datatiles). In one such embodiment, a substrate is scarmed to 
create an image of the datatile and the locations of all markers in the datatile are detennined and stored in 
20 the feshion described above by reference to the prefierred endxxiiment. The fiirther steps of locating cell 
centers and spots are performed only as to the currently itesired datasector or dataseaors. 

In the^prefencd oobodiment, the recovery process first exdusive-ORs the sequence of bits with 
precisely the same random sequence of bits that was employed in the encoding process, described above by 
reference to FIG, 2. Whether or not the sequence of bits is thus altered, the recovery process now 
25 reconstructs codewords from the sequence. The codewordsare interpreted to produce the original data. The 
ultimate result of tiie recovery process is, then, a scries of digital data values. The information expressed by 
this series of digital data values depends on the source of the recovery. In the case of recovery of data from a 
nketasector, the series of digital data values represents the information contained in the metasector, primarily 
the format parameters used to encode the main body of data. In the case of the main body of data, the series 
30 of^igitaldata values produced is the ui^nx^essed data ftom which the method of decoding produce 
original computer files or other digital data after fiirther processing that includes decompression and, 
possibly, decryption. 

The^iecuvoy process has further embodiments reflecting the different embodiments of the method of 
encoding. Where the method of encoding places multiple biu in each cell through the use of multiple colors 
35 (such as varying levels of gray), the recoveiy process preferably determines the cerUers of cells (i.e., the 
centers of possible spots) in a fashion described above but then determines not merely the presence of a spot 
at the cell's center but also the color of any spot present. 

Where the method of encoding places multiple bits in each cell through the use of multiple spot 
sizes, the recovery process again preferably determines the centers of celts in a fashion described above but 
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then detennines not merely the presence of a spot ai the cell's center but also the size of any spot present. In 
one embodiment, the size of a possible spot is preferably determined by first testing the center pixel f a celt 
(i.e., the pixel at the intersection of the lines through the column and row of the possible spot) to determine 
whether a spot exists. If a spot exists, this method of decoding then tests all contiguous pixels (i.e.. pixels 
5 one pixel removed from the center pUel) aiul then, depending on the maximum size of possible spots, tests 
all pixels 2 pixels removed finom the cemer pixel, and then retest pixels even fuctber removed. This 
methodology can be applied to the dalatile a portion of which is illustrated in FIG. 14. Cell 1409 contains a 
spot with a dark center atui a gray border on all sides. The method first tesu the center pixel, finding a dark 
spot. Dq)ending on the primer/scaimer resolution ratio, the method may continue to find dark pixels 
10 emanating out from the center pixel in the scaimed image. Eventually, the method would encounter gray 
pixels. Having found both dark pixels at the center and gray pixels at the periphery, the method determines 
that the spoi in cell 1409 represents the logical state expressed by a spot with a dark center and gray 
periphery. Spots such as those in cells 1402 and 1403 are determined by the dark pixels at the center aiMl 
dark pixels on the peripheiy with the difference between the two spots determined by the number of pixels 
1 5 that are dark. Spots such as those in celts 1406 and 1407 are determined in a like fashion to the spots in cell 
1402 and 1403 except that gray is found in the center and surrounding pixels. Adjtistments obvious to those 
skilled in the art are made where the pixel determined to be at a possible spot's center is iu>t in &ct at the 
spot's exact center. For example, if the centroid pixd of a-spotdiftetem the;pixcl:detenninecbto 
intersection of the column and row containing the spot, the centroid pixel is used as the starting point instead 
20 of the pixel at the intersection. 

In another embodiment, which can be applied where the datatile encodes multiple bits per cell by 
varying the size of spots or both the size and color of spots (other than variations of color based solely on 
intensity such as varying levels of gray scale), the method of decoding determines the intensity of each image 
pixel that may contain all or pan of a particular spot, accumulates those intensities and compares the 
25 aggregate intensity to ranges of intensities that correspond to varying spot sizes to determine the size of the 
spot Where various colors were also used in encoding (e.g., cyan, magenta, yellow and blade), the method 
of decoding detennines both an aggregate intensity and color. 

Where the method of encoding employs multiple spot and cell sizes the recoveiy process is adjusted 
so as to determine each cell's center. The manner in which cell centers are determined would generally 
30 foUow the recovery process described above except as acyusted to rcflea the various sizes. Likewise, the 
recovery process is acQusted to reflect each of the other embodiments of the method of encoding where these 
requisite adjustments should be apparem to those skilled in the an of imaging. 

HG. 19 illustrates the recovery process as ^jplied tD-a-porttonfo^annmage^ of^a digital iy encoded 
substrate produced by one embodiment of the inventioiL It should be understood that FIG. 1 9 represents a 
35 substantially enlarged view for the purpose of illustrating the process. RG. 19 references the following 
pans: columns 1901 of markers, the distance from markers to the closest possible spots 1902, spot 1903, cell 
1904, center 1905 of the £urst maiker, center 1906 of the next marker displaced horizontally, center 1907 of 
the next marker displaced vertically, line 1908 through the center of the top row of possible spots, line 1909 
through the center of the second row of possible spots, line 1910 through the center of the first column of 
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possible spots, line 1911 through the center of the third row of possible spots, and Une 1912 thnjughthc 
center of the last column of possible spoU. The substrate has markers located in the image f FIG. 19 in 
columns 1901 consisting of 4 markers at the right and left perimeters of the image. These markers have 
dimensions 3 printer pixels wide by 3 printer pixels high. The distance from markers to the closest possible 
5 spots 1902 equals 5. Each spot, such as spot 1903. is 3 printer pixels wide by 2 printer pixels high contained 
in a cell, such as cell 1904, which is 4 printer pixels wide by 3 printer pixels high. Each spot should be 
understood as occupying the precise center of its corresponding cell. Accordingly, each cell containing a spot 
has a blank border 0.5 printer pixels wide along the right, left, bottom, and top of the cell. Also, the lines 
through the centers of any rows or columns of possible spots are the same as the lines through the centers of 
10 any corresponding rows or columns of cells. The number of spots per segment, 15, is illustrated in FIG. 19 
by the 15 cells, some with spots, some blank, located between the 2 columns of markers. There are 3 rows of 
possible spots b^een markers displaced vertically. The information concerning primer pixel sizes and 
distances, the number of rows between markers and the number of spots per segment is conveyed by the 
metaseaor of the preferred embodiment and is therefore known to the recoveiy process.' 
15 Having found the first marker, the rccovciy process finds the center of that first marker, here located 

at 1905. In the preferred embodiment, pixels are deternuned to be part of the inarkcrlo' virtue of ha^ 
gray scale level bekiw a threshold. The coordinates of the pixels contained in the marker are averaged after 
bcing^weigfateAtaidcteimiBeitfacaamgEa ^rin;^^ _The:iecoveiy process then determines the center 1906 
of the next marker displaced horizontally and the center 1907 of the next maiker displaced vertically through 
20 the process described above in steps 1802 and 1803 of FIG. 18. 

Having determined the centers of three reference poim markers, the recovery process of the 
preferred embodiment uses that information, as well as information conveyed by the raetasector, to determine 
the lines through the centers of the columns and rows of possible spot locations. If an image has no skew, 
the line 1 908 through the center of the top row of possible spots is determined to be one-half printer pixel 
25 higher than the vertical pixel coordinates of the center 1905 of the first marker and the center 1 906 of the 
next marker displaced horizontally. This determination of the central line through the row is made d\ie to a 
number of factors. First, the top of the first row of possible spots in FIG. 19 is known to be at the same 
location as the top of the highest markers in FIG. 19, this fcahire having been established as a convention <rf 
the preferred embodiment Second, while the markers are known to be 3 printer pixels high any spots are 
30 known to be 2 printer pixels high - both heights are conveyed by the metasector. The recoveiy process can 
accordingly infer that the vertical centers of aziy possible spots in the first row should be 1 printer pixel down 
from the tops of the spots (a spot height of 2 printer pixels divided in half) while the vertical centers of 
mazkers^shouhi'be^HSO primerpbcds down from the tops of the maricers (a marker height of 3 printer pixels 
divided in half). Because the tops of the spots are known to be at the same location as the top of the maricers, 
35 the recovery process can accordingly infer that the vertical centers of the row of possible spots is .50 (i.e., 
1 .50 - 1 .00) printer pixels higher than the maricers* cemers. Because the adjustment of one-half pixel is 
expressed in printer pixels and the vertical pixel coordinates of the marker centers 1905 and 1906 arc 
expressed in image (e.g., scanner) pixels, and printer pixel size may differ from image pixel size, the 
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adjustment of nc-half must be first muitiplicd by the image to printer pixel ratio to determine the actual 
adjustment in image pixels. 

The ratio of image pixels to printed pixels is determined immediately after decoding the metasector. 
The dimensions of the metaseaor in image pixels (e.g., its overall length) are kix>wn after decoding it In 
5 addition, the metasector internally egresses the multiple the metasector dimensions arc, in printed pixels, of 
the "base" case (by convention, configoied to be printed at 300 dpi, and scanned in at 400 dpi.). The ratio of 
image pixels to printer pixels is therefore the length of the metasector in image pixels, divided by the product 
of the multiple and the length of a metasector in printed pixels in the base case. 

The recovery process determines the centers of subsequent rows of possible spots by reference to the 
10 relative printer pixel displacement from the top marker to the next marker displaced verticalty. The recovery 
process first determines the printer pixels down fiom the center 1905 of the first marker to the center of each 
such subsequent row of possible spots. The recovery process determines this printer pixel distance by adding 
one-half the printer pixel spot height, the product of multiplying the primer pixel cell height by the number 
of rows down a particular row is from the top row, and subtracting one-half the printer pixel marker height 
15 The recovery process would then determine the total printer pixels down from the center 1905 of the first 
marker to the center 1 907 of the next marker displaced vertically. This is here determined to be 9 by 
multiplying the number of rows of possible spots between markers of 3 by the cell height of 3. A ratio of 
printer pixels down for each row to the total printer pixels down between craters-l 905 and 1907 is then 
computed. The recovery process then determines the image pixels down between the centers of the first 
20 marker and of the next marker displaced vertically, 1905 aiul 1 907, respectively. For each row, the recovery 
process multiplies the printer pixel ratio for the row by the total image pixels between centers 1905 and 1907. 
The result is the image pixels down for the central line through each such subsequent row. 

If for example, the digitally encoded substrate was printed at 300 dpi and scanned at 600 dpi with no 
skew or i^^>erfections, the line 1909 through the center of the second row of possible spots would be 5 image 
25 pixels down from the center 1905 of the first marker. The line 1909 through the center of the second row of 
possible spots is 2.5 printer pixels down from the center 1905 of the first marker. The recovery process 
determines this by adding 1 (one^lf the printer pixel spot height of 2) plus 3 (primer pixel cell height of 3 
multiplied by 1 » the number of rows down from the first row to the second row), and then subtracting 1.5 
(one-half the printer pixel marker height of 3). The total printer pixels down from the center 1905 of the 
30 first maiker to the center 1907 ofthe next inarker displaced vertically equals 9, rows per marker of 3 
multiplied by cell height of 3. These conclusions regarding printer pixels are inferred from information 
conveyed in the metasector and therefore known by the recovery process. The ratio ofthe printer pixels 
down from the center 1905 ofthe first marker to the line 1909 through the center of the seoond=row of 
possible spots to the total printer pixels down between the center 1905 ofthe first marker and center 1 907 of 
35 the next maricer dis p l aced vertically equals 2.5:9. This ratio is then multiplied by the image pixels down 
between the centers 1905 ofthe first marker and 1907 of the next inarker displaced vertically. The image 
pixels down between the cemers 1905 of the first maiker and 1907 <^the next marker displaced vertically 
should equal 18 (a dOOdpt scan should produce a distance in image pixels double the printer pixels produced 
by a 300 dpi printer). Multiplying the ratio 2.5:9 by 18 image pixels results in a determiiuition that the line 
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1909 through the center f the second row is 5 image pixels down from the center 1905 of the first marker. 
Thus, for example, if the center 1905 of the first marker has a vertical image pixel coordinate of 70 (i,e.» 70 
image pixels below the top edge of the image produced by the scanner), then the line 1909 through the center 
of the second row has a vertical image pixel coordinate of 75. 
5 Having determined the lines through the centers of the rows of possible spots, the recovery process 

dctennincs the line 1910 through the center of the first column of possible spots. The line through the center 
of each column of possible spots is determined by reference to two Victors, first the ratio of the primer pixel 
distance of that column's central line from the center 1905 of the first marker to the printer pixel distance 
from the center 1905 of the first marker to the center 1906 of the next marker displaced horizontally, and 
10 second, the image pixel distance from the center 1905 of the first marker to the center 1906 erf" the next 
marker displaced horizontally. The recovery process determines the line 1910 through the center of the first 
column of possible spots to be 8 printer pixels to the right of the center 1905 of the first marker. The 
recovery process makes this determination by using information conveyed in the metasector. The Marker 
Width parameter was set at 3 , the Marker to Spot parameter was set at 5, and the Spot Width parameter was 
15 set at 3. Accordingly, the horizontal distance from the center 1905 of the first marker to the line 1910 
through the center of the first column should equal the sum of one-half the marker width, 3 x .5 « 1.5, the 
markertospotdistanceof 5andone-halfofthe^width« 3x.5'= 1.5. This sum equals 8. Foreach 
subsequent colomn, lhe:recoveiy.pi^ K » v arirti^to=this Miiteiaiixrf ^^^^^^ from multiplying 

the printer pixel cell width of 4 by the number of columns the subsequent column is displaced from the first 
20 coiumiL The recovery process then computes the total distance in printer pixels from the center 1905 of the 
first marker to the center 1906 of the next marker displaced horizontally. This computation is performed by 
summing the foikiwing distances measured in printeri»xels as comsmmcated by the metasector: the distance 
from the center 1905 <rf the first maricer to the center of^ first spot, 8 {8 = .5 x printer pixel marker width 
of 3 + the distance from markers to the closest possible spots 1902 of 5 + .5 x printer pixel spot width of 3), 
25 the distance of 56 from line 1910 through the center of the first column of possible spots to the hue 1912 
through the center of the last column of possible spots (56 = cell width of 4 x 14. the number of columns 
separating the centers of the first and last columns determined by subtracting 1 from the Spots per Segment 
of 15), and the distance from the center of the last spot to the cemer 1906 of the next marker displaced 
horizontally from the first marker of 8 (8 « .5 x printer pixel marker width of 3 + the distance from markers 
30 to the closest possible spots 1902 of 5 + .5 x printer pixel spot width or3). This sura equals 72. The 

recovery process then determines the total distarux in image pixels from the center 1905 of the first marker 
to the ceruer4906 of the next marker displaced horizontally. The lines through the centers of the columns of 
possible spots^iniinageipixeU'displaced from the ccmo^ 190^ of the first marker, are then determined by 
multiplying this total distance in image pixels by the ratio of the printer pixels from the center 1905 of the 
35 first marker to the line through the center of each column of possible spots to the total printer pixel distance 
from the center 1905 of the first marker to the center 1906 of the next marker displaced horizontally. 

It for example, the digitally encoded substrate was printed with a 300 dpi printer, scarmed with a 
600 dpi scaimer, and the printing and scanning processes had no imperfections, the line 1910 through the 
center of the first column of possible spots should be 16 image pixels to the right of the center 1905 of the 
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first marker. Thus, if the horizontal image pixel coordinate of the center 1905 of the first marker is, for 
example. 1 10 image pixels to the right of the leftmost edge of the image produced by the scanner, the line 
1910 through the center of the first column of possible spots would have a horizontal image pixel coordinate 
of 126. The total distance from the center 1905 of the first marker to the center 1906 of the next maiker 
5 displaced horizontally should be 144 image pixels, double the printer pixel distance of 72, because the 

scanned image should twice as large in pixels as the printout due to a scanner with twice the resolution. This 
distance of 144 image pixels is multiplied by the ratio 8:72 to detennine the horizontal distance in image 
pixels from the center 1905 of the first maiker to the line 1910 through the center of the first column of 
possible spots. The product, 16 image pixels, is added to the horizontal image pixel coordinate of 1 10 of the 

10 center 1905 of the first marker to produce the horizontal image pixel coordinate of 126 for the line 1910 
through the center of the first column of possi*blc spots. A similar methodology is enq>l0yed to detennine the 
lines through the centers of each subsequent column of possible spots. 

Having determined the lines through the centers of rows of possible spots and the lines through the 
centers of columns of possible spots, the recovery process can then look to the intersection of the row and 

1 5 column central lines for each possible spot to determine if a spot is in fact present or absent Accordingly, 
the recovery process can thereby determine one bit of the series of digital daU values. These determinations 
may depend on contexmal information. Thus, if all the spots in all surrounding cells are present (i.e., **on"). 
it may very well be that the cell is relatively dark, even though no spot is present In sucka casc;.an 
adjustment in the threshold for calling a bit on or ofi^ may reduce bit errors. 

20 While the description above made by reference to FIG. 1 8 and FIG. 1 9 is sufficient to allow one 

skilled in the ait to implement the decoding process, the following routines provide more explicit detail of a 
methodology to decode a grouping of cells and markers constituting a datasector. The primary routine listed 
below is "findmarkers" which in turn calls other routines, including "decodcdotstripnew**. 

25 void decodedotstripnew(float x_bar,f1oat y_bar, float lastxstrip, float lastystrip, 

float pixiToPixp3 YTE huge • in,BYTE huge *outbuf;MEMORYSTRUCT 

memoryStruct 

BYTE huge ♦savcIUnt huge *histpix,int huge ♦XIndTablcchar ♦ dommyfillarray, 
char • dummyfill3YTE huge •workS,inl * noHeaderCalledOn,int ♦ noHcadcrCalledOflf, 

30 long * totalHeaderCaUedQn,long * totalHeaderCalledQff^int *noCloseCaIisSegmeat 

int *noClo$eCalls4ong huge * errorArrayUnt erTorInd,int * erTorI,iiu dataRow, 
float maxYAdjDefmed,float minYAdjDefined,floatylncrAdj,int adjustUstlncr, 
int noIntervals,long * Gutind,long cxDib, long cyDibJong jcomer. long jimage, 
int mixiempty,int *bitnumber, unsigned char *dummyO, long ^totalbits. long 

35 totalNumCodcBiu, 

int borizontaUIoat invslope, int top, int header jnt neameighbor,int xind, int adjustDist,int 

faxFile. 

int hypothesis,int performCalibration^int * calBitRowStartlong • totailiUCalBitOa 
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int * niunCalBitsOiulong * toiaJIntCalBilOff;im ♦ numCalBitsOfiF,int 
processCloseCallArray, 

int caiibratelnRow.int firstCalPatBitAcrossjnt niiinCalPatBitsAcross,int dispIaySpots) 

{ 

^ unsigned char dummyl; 

int minCloseCall, maxCloseCalL; 

float x,y,xincr,yincr,distancd)etwcendcits,oostbeta,5i^ 

measiiredDist,nextdoU, x£xcess»y£xcess,micPixiToPixp,avgorient; 
long ofir$et>yint,i,noCloseCall$SegnientQS5et,imgi]3d; 
10 int ncxtChangc.Ylnd,xExccsslO,yExoessIO,nuinspots,x_barInd,XInd,kk,k,xi 
calBitcalBitOaniine]nptyint,valiieint; 
#define KERNELCOMPARESIZE 3 
float \vcight[KERNELCOMPARESIZE*KERNELCOMPARESIZE]; 
float totaiweight,valuereal; 
15 int excessl.excess2,excess3,excess4,invokeiCemd; 
static int huge * YlndTable; 
static BYTE huge * closeCallArray; 
static BYTE huge * doseCalilntensityArray; 
static iitt huge ♦closeCallList; 
20 float huge * adjusiList; 

static BYTE huge *erforAnayImagc; 
YlndTable « memoryStnict YlndTable; 
adjustList = inemoryStructadjastList; 
closeCallAnay mcmotyStiuct.closeCallAnay; 
25 closeCalUntensityArray ■» menioiyStruct.closeCalUntensity Array; 
CloseCallList = menioiyStnictcloseCallList; 
errorArraylmage -= nieinofyStnict.aTorAnayIraage; 
if(header&&£ixrile— 2) 
invokcKcmel^l; 
30 elseif(hypothcsis>MAXNUMBERREKlOCESSES/2) 
invokeKemel=l; 

else 

invokeKemeM); 
if (invokcKenicl){ 
35 neameighborK); 
if (header) { 

vraght(0)-l.O;wdght(ll-1.0;weighi[2)-1.0;wcightPl=1.0;weight[4)=1.0; 

weightI51=1.0;weightf6]-1.0:weight[7J=1.0;wcight[8)=1.0; 

} 
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el5e< 

wdght(OJ^.0:w«ight[IJ=1.0;weight(2I=<).O;wcight[31=l.O;wcig^^^ 

wcight[5)= l.0;weight[6]«O.0;weight[7]= 1 .0;weight[81=0.0; 

) 

5 totalweigfat=0; 

for (k==0;k<KER^ffiLCOMPARESIZE•KERNELCO^^ARESIZE;k++) 
lotalwcight+=weight(kJ; 

} 

totalNiiniCodeBit5=^00*8; /* pass in from outside I */ 
10 diinmiyfiiWuminymiarray4<*totalbits%I^^ 
prooessCloseCall A]Tay= 1 ; 
if(*calBitRowStart){ 

*caiBitRowStart«K); 
calBitOn=l; 
15 } 
else{ 

*calBitRowSlart=l; 

calBitOn=0; 

) 

20 dummy]"! ; 

x_barlnd=(int)x_bar, 
Xlnd=0; 

if (neameiglibor){ 

x_bar+=0.5; 
25 y_bar+«0.5; 

lastxstrip+=0.5; 

lastystrip+«0,5; 

minemi>tyint^int)minempty; 

mmCloseCalNmincmplyim-MINCLOSECALLDIFF; 
30 maxaoscCall»mincmptyint+MAXCIX)SECALLDIFF; 

> 

else{ 

#dcfine TESTTTREAL 0 

mincmptyint=<int)mincmpty*64; 
35 minaoscCall=TOincmptyint-MmCIX)SECAUJ)IF^ 

maxCtoscCall=minemptyint+MAXCLOSECAIiDIFF*64: 
> 

if (header) 

numspots^numberheaderspotsperseg; 
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numspots^numberspotsperseg; 
if (processCloseCall Array) ( 

noCloscCallsScginentOffsei==(long)(daiaRow^-l)*(Jong)(niimspots+2); 

closeCall ArraytnoCloscCallsSegincmOffsctJ» 1 : 

closeCailArrayfnoCloseCallsSegmentOfifset-KnumspotS't-l )]=1 ; 

cio5cCallIntensttyArray[noCloseCallsSegmentOfito) =*nunempty; 

closcCalllntensityArray (noCloscCaJIsScgmcmQffisct+(nuinspots+ 1 )]=inincrapiy; 

) 

if (header)! 

tnicPixiToPixp=(lastxsirip-x_bar)/distbcUicadniaikcciits; 
mcasuicdDisl=sqrt((x_bar-lastxstrip)*(x_bar-Iastxstrip)+ 

(y_bar-Jastystrip)»(y_bar-lastystrip)); 
tniePixiToPixp=measuredDist/distbclhcad0iarkccnts; 
(U5taxicebetweendots=Htistaiicebetweenheadcrspotsacros5*tmePix^ 
ncxtdotx==distbeadmarkcenUospotcent*lnicPixiToPixp; 
} 

clsc{ 

tmePixiToPixp=<lasustrip-x_barVdistaiKebetweciimarkeK;e^^ 
mcasuredDist=sqrt((x_bar-lastxsirip)*(x_bar-Ustxstrip)+ 

(y_bar-Jastystrip)*(y_bar-lastysirip)); 
tnicPixiToPixp=^easuredDist/discanccbctwccninarkcrccn^ 
distanccbetwecndots=^stancebetweenspotsacn)SS*tnicPixi 

ncxtdotx==distanccmarkcicciitcrtospotccnicr*tnjcPixiToPixp; 

tf(xind){ 

setYIndCYIndTable^numspots, 

x_bar-0.5, y_bar-0.5, la5txstrip-0.5, invslope, /* 0.5 subtracted since 

added above to y_barl */ 

nextdotx, distancebetweendots); 

} 

} 

if (febs(invslopc)>0.0000 1) 

avgoriem«atan(-iiivstope); 

else 

avgorient=0.0; 
costhcta=oos(avgoricnl); 
5tntheta»sin(avgonent); 
x=«x_l)ar+ncxtdotx*costhcta; 
y=y_bar+nextdotx*siiitheta; 
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xincr^distancebetweendots^costheta; 
yincr=disianccbctwccndots*sintheta; 

Ylnd=0; 
ncxtChangc=YlndTablc[YIiul); 
ymt*=(int)(y_bar-0.0) ; 

offset«((long)yim-jcoraer) ♦cxDilH- (lotig)x_barInd; 

for (i=0;i<nuinspots;i++) { 

if (calibrateIiiRow&&(t>»fir5tCalPatBitAcross)A& 

(i<(firstCalPalBitAcross+ numCalPatBilsAcross))) 

calBit«l; 

eUe 

calBit=0; 

if(xind){ 

if (header) 

i mgind«({long)y-jcomer)*cxDib+<long)x; 

else 

{ 

if (i<nextChaiige) 

t 

else{ 

if(invstope<0.0){ 

ofitset+=cxDib;yint++; 

} 

else{ 

offiset^xDib,"yim-; 
} 

Yliid++; 

nextChaiige=YIndTable[YIiid]; 
} 

inigind*offisct+XIndTabIe[XInd++J; 
} 

} 

else 

{ 

if (adjustDist&&lheader){ 
iot adJDefined; 

printCoordToIinageCooid(adjustLisC x, y, 
AxAdjusted, &yAdjusted, 
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maxYAdjDcfmed, 
minYAdjDefiiied, 
yIncrAdj. 

adjustListlncr. &adjDefliied); 
iingind=((long)yAdjusted-jconier)*cxDib+(Iong)xAdjustcd; 
} 

imgind=((long)y-jcomer)*cxDilH-(long)x; 

10 if (ncameighbor) 

valueintH nfiingind] ; 
else{ 

if (adjuslDist&&!headcr){ 

xExce55==xAdjiisted-(int)xAdjusted; 
15 yExcess=yAdjustcd-(int)yA(ljuslcd; 
} 

else{ 

x£xccss=x^iii^t;)£xcess^-(tm)y; 
> 

20 #ifTESTrrREAL 
#eise 

#dcfinc FOURPIXEL 0 

#ifFOURPIXEL 

#else 

25 #ifKERNELCOMPARE 

xExccss 10«(inO(xExccss*8); 

yExcess lO=(int)(yExcess*8); 

excess 1 *x£xcess 1 0*yExccss 1 0; 

excess2=(8-xExcesslO)*y£xcesslO; 
30 excess3=^xExcesslO*(8-yExoesslO); 

cxocss4=(8-xExcesslO)*(8->«xccsslO); 

valuereal=0; 

for (k-<),xindinc=.<KERNEtaDMPARESI^^)^e<^ 

for (kk«0.yiIKync«-(KER^ffiUX^MPARESIZE/2)♦c^ 
35 kk<KERNELCOMPARESIZEUck-H-.yiiidincH*cx^ ( 

pixelCtontribuUon*KfloatXin[imgind+cxDib+-l+yindinc^Td 

infimgind+cxDib+yindincM-xindinc] *cxcess2+ 
in(imgind+ l+yindiiic+xindinc]*cxcess3+ 
infimgi nd-^ndinc-t-xindinc] *excess4) ; 
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valuereal+KpixdContribution*wcightpCERNELCOMPAI^SI2E*kk+^^ 
> 

valueint=(intK(float)valuereal/total weight); 

5 #else 

#ifINVOKEKERNEL 

if (invokeKemet) 

#el5e 

if(0) 

10 #ciidif 

{ 

xExccssl(Hint)(xExoess*8); 
yExcess iO^(intXyExccss*S); 
excessl=*'x£xcesslO'*yExcesslO; 
1 5 exccss2«(8-xExccss 1 0)*yExccss 1 0; 

exoess3=xExcesslO*(8-yExcess 10); 

exoess4=(8-xExccsslO)*(«-yExccsslO); 

valiiercal=0; 

for (lr=0,xindinc«- 

20 (KJERNElXOMPARESlZE/2);k<KERNELCOMPARESIZE;k-H-,xindinc^ 

for (kk«<),yin<iinc*-<KERNELCOMPARESIZE/2)*cxDib; 
kk<1CERNELCOMPARESlZE;kk-H.^yindinc+-===cx^ 
pixelContribtidcm^float)(in[imgind+cxDib+ 1-^yindincHoundi ♦excess 1 + 
in(imgind-K:xDib+yixidinc+xindinc] *cxccss2-i- 
m(imgind+l-tyindinc^xindiiu:)*excess3+ 
in[inigind+yindinc+xindinc] *excess4); 
valucrcal^(pixdContribution*wcighi(KERNELCOMPAI^SIZE 
) 

} 

30 valueint=(inO((l]oat)valucrcal/totalweight); 
} 

else( 

xExcessl 0=(int)(xExcess*8) ; 
yExccsslO«(int)(yExcess*8); 
'5 valueintHn[iingiiid^x:xDi>i-l]*x£xcessIO*y£xcessia+in{im 
xExcesslO)*yExoes5lO+ 

in(imgind+l]*x£xcesslO*(8-yExcess I0)+ 
in(iingindl*(8-xExccsslO)*(8.yExcesslO); 

} 
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#endif 
#ciidif 
#endif 

} 

if <perfonnCalibratioii&&caiBit){ 

if {calihratcInRow&A(i>'=nrstCalPalBilAcross)&& 

(i<(firstCaiPaiBitAcro5s+ nuinCalPatBit5Across))){ 
if{caIBitOii){ 

if (proccssCloscCall Array) { 
if (tneameighbor) 
CloscCallInlensityArrayJnoCI05eCallsScgmcntQffscl+i+l]»^faluci 

else 

closeCallIntcnsityArrayInoCloscCallsSeginent0^l+i+l|=valueint; 

cliiseCall ArraylnoCloseCall sSegmentOf&et+i-*- 1 1^; 
} 

•totalImCalBitOn+«valueint; 
•mimCalBitsOn+== I ; 
caiBitOikH); 
} 

else{ 

if {proccssCloseCallAriByX 
if (tneameighbor) 
<^aseCaIIInlensityArr^[iK>Closc<:^lsSegmcmOf&et-H'^l]=^ 

else 

closeCallImeiisityArray(noCloseCallsSegmentQfirset+i+ 1 l=vaiueint; 

closeCallArray (noCloseCallsSeginentOffsei+i+ 1 1 ; 
} 

♦totalIiitCalBitO£f+=vaiueinl; 

♦numCalBitsOff+»l; 

calBitOn^l; 

} 

) 

> 

if (!peifonnCaiibratioii&&!calBit){ 
if (valueint < minemptyiiit) 
{ 

if(header){ 

(♦noHcaderCallcdC)n)+= 1 ; 
if (neaxoeighbor) 
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(*totalHcaderCaIledOnh*^=valucint; 

else 

(♦totalHcaderCalledOn)+=^lueint/64; 

} 

if (processaoscCallAnay){ 

closcCallArraylnoCIoscCallsSegmcntOflfect+i+ 1 J'^O; 
if (Ineamdghbor) 

closeCalilmensityArTayinoCloseCallsScgmentOffset+i'f I ]=valueint/64; 
else 

closeCallIntensityAfTay(noCk>seCallsSegmen(Oaset+i+ l]«^alueint; 

if«valueint>miiiCioseCaU)&& 

(*noClaseCallsScgment<MAXNOCLOSECALLS)){ 
closcCallUsi(*noaoscCallsScgrocnt*CLOSELISTEhm 
doseCdlIi5t{*noClose<^hSegment*CLOSELISTENTRY3IZE-f 1 ]=dataRow; 
closeCallList[*noCioseCallsSegment*CLOSEUSTEmilYSI2£+2^ 

doscCallUst(»iK)CloseCallsScgment*ClX>SELISTEhrmYSIZE+3)^ 
doseCallList[*iK>CloseCalhScgincnt*CLOSELISTENTRYSIZE+4)=^uM^ 
if (Ineameighbor) 
closeCalUjstrBoCloscCallsScgincnt*CU)SELISTEhrmYSim 

else 

closeCalIList(*noCloseCallsSegment*CLOSELISTEhrrRYSIZE+3]^; 
doseCalUist{*tioCioseCallsSegmeQt*CLOSEUSTENTRYSIZE+6]»ini^ 

*noCloscCalls^-=l; 

*noCloseCallsS^ent+« 1 ; 

} 

} 

ifC^dummyfin^lX 

worfcS[notaU>its)«0; 
*(hunmyO=»*dunnnyO|dufnmy 1 ; 
} 

else 

workS[notalbitshl; 
dunmiyfill-H-; 

} 

else 

{ 

if (header}{ 

(♦noHcaderCalIcdOflf)+=l ; 
if (neameighbor) 
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(*totalHeaderCalledOfiD+»^alueint; 

else 

< *totalHcaderCalledOfiO+=valueint/64; 

} 

if (processCloseCall AnayX 

closeCall Aino'[noaoseCallsSegmentOfirset+i+ 1 ]= 1 ; 
if (Ineameighbor) 

closeCalllntensity Array [noCioseCa]lsSegmentOfi^+i+ 1 ]'=valueint/64; 
else 

closeCalUntdisity Array [noCloseCall5SeginentOfiGset+i+ 1 )«valueiiit; 

if ((vatueint<niaxaoseCall)&& 

(*noaoseCallsSegmem<MAXNOCLOSECALLS)){ 
closeCaIlUst(*noCk>scC^sScgmcnl*ClX)SELISTEhnilYSIZEl^ 
doscCallUst[*noCloscCallsScg^^ent*CLOSEUSTE^^rRYSIZE+l]=^ 
closeCallList{*m)CloseCaUsSeginent*CLOSELISTEOTTlYSIZE+2)=*bimui^ 

closeCallList(*noCloseCallsScgmem*CLOSEUSTEhrmYSIZE+3]=*ouund; 
closcCallList(*noCioseCallsSegment*CLOSELISTEhrrRYSIZE+41=valueiiit; 
if <!neameighbor) 

closcCallList[*noCloseCallsSegment*CU:)SELISTENfTRYSIZE+51=l; 

else 

closcCallList[*noCloscCallsScgment*CLOSELISTENTRYSIZE+5)=0; 

closeCallList[*noCloscCansScgmcnt*CI.OSELISTENnTlYSIZE+6]=imM 
♦noCloscCalls+«l; 
♦noCloscCallsSegmciit+^l ; 
> 

} 

i^*dummyfiU«»l) 

workS[»tolalbitsl=0; 

else{ 

\voikS[*totalbits]=^l; 
*diuninyO-*duiiunyO|duminy 1 ; 

} 

dumitiyfiU++; 

} 

(♦totalbits)++; 
(•bitnumbcr>++; 
if (•bitnumbcr>7){ 

♦bitnumbcr«*0; 

outbufI*outindl=*dumnTyO; 

4S 

SUBSTITUTE SHEET (RULE 26) 



wo 97/32262 



PCT/US97/03330 



*oulind+-l; 
*dummyO=0; 

if((*totalbiU%NUMBERBITSDUM\rVTILL)'-^ 
duiiiinyfin==danunyfillarray; 

5 } 

♦duininyO=*dummyO « 1 ; 

> 

if(xiiid){ 

if(header){ 

10 x=x-*-xincr,y=y+yincr. 
} 

) 

else{ 

?c=x+xincr,y=y+yincr, 
15 } 
> 

} 

inf findTw>rkgra(R VTF hiig^ * fpTKhBiu HVTF hug e^* ouuMEMORYSTRUCT mcmoryStfuct 
int huge ♦ calPatDescriptors^nt noCaiPats^int huge * calAvgArray, 
20 int huge * prevMinEmplyArray.int imnemptypixeUnt minEmptyMinErrorsjnt * 

avgmineinpty, 

BYTE huge • saveluint huge * histpix^YTE huge * luUB YTE huge * hcadcrlafo, 
iloat huge * bonomMafkersStnp^ huge * botlomMarkerlnteusity, 
float huge * rightMaiker.int huge^ rightMaiixrIntensity, 
25 int * numbennaricersRight^long *totaIbits»iang totalZeros.long totalOnes* 

tnt * cninemptyAdj^ong huge * erroxAnay^int errorInd,iAt * avgHeaderCalledOn. 

int * avgHeaderCalledOfif;float * adjustRatio, im tileAcross, int tileDown, 

int DoTilesAcross.int noTilesDown,int numberlterations^nt windowsizc, 

long totalNumCodcBits^float bottomx,float bottomy.double ^costheta, double *sintheta, 

30 float *pixiToPixp» 

float *pixiToPi^LocaLdouble *avginvsk)pe^ng cxDib, long cyDib, 
long joorner. long jiroage Jong ofiset^int *prtvMaxkerhitensity. 
long^tengditSodeWonirfan^ nnmberOataBitsHong numberBitsData, 
int top, int left, int header, int topTile, int leftTile. int * foundTile. 

35 int pFoocssCloseCaUArray.int resolutionFactor.int highBitErrDrRate,int flipEm, 

int iaxFile,int neameighboraiu xind^int automaticjnt adjustDist^im hypothesis, 
int displayMaiker, int dispIaySpots. int scaleMarkPresent) 

{ 

static int huge * hist;static int huge * hist 10; static int huge * resetTablc; 
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Static int huge * XIndTable;static int huge * YlndTable; static float huge ^mlisll; 
static float huge *mlist2; static int huge *misvilistl; static int huge *mintList2; 
static int huge ^markerintlistt; static int huge *iTiarkerintlist2; 
static float huge ^markerlistl; static float huge *markerlist2; 
5 static float huge *adjustList; static BYTE huge * closeCallArray; 

static BYTE huge ^ closeCalllntensityAnay; static int huge * adjustlntensity Array; 

static int huge *cIoscCallList; static BYTE huge ♦ workS; sutic BYTE huge *errorAnayImage; 

static int noClo5eCalisScgment;static short * dutnint;static unsigned char dummyO; 
static int duinint2;static long dumlong; 
10 static int noCloseCaiIs,displayMarkciTemp,bitnumberJnteTval,calBitRowStan; 
static int noKeaderCatledOn^noHeaderCalledOffjeProcessHyp; 

static long totminempty.totallntCalBitOn. totallnlCaiBiiOff.totalHeaderCalledOn^otalHeaderCalledQff; 
static float 

cornenc^comeiy Jastmarkerx, lastniarkery . interlncr^nieasuredDist 1 ..measuredDist expectedDist, 
1 5 fnarkcitx)tx,markerboty, newInvslope»avgoricnt,xlncr Adj^ylncrAdj , 

tenipx,tefnpy,inaikerx,markeiy,dunimy,staitx»starty,lastx,lasty. 
distComejToLastMaik,inaikertopx,markertopy; 
static float roea5uredDistBetCornerLastMaik,spotToMarkerAdjust,xIncr,resfactfloat, 
spotToMarkerAdjustScaled^dbmese; 
20 static int errorl,prtnterType>numFFomTop,niunbeidatasegs,nolmervals,prevMarkerInte^ 

markerlistlncr.adjustListlncr^numspots^redundancyLevelData, 
j,k,minemptyJj,numbennarkersl.]ircvnumberntaxkeis,markerStart,foi^ 
min£mptySegment,seaichSegmentLength,numbennarkers2 .maxintensiiy, niinintensity; 
static double invslope; 
25 static long l.outind,i,noCloseCaUsSegmentQfiset,totalintensity; 
static float xCoord, yCoord^xDistonion. yDistortion^printXl.printYl, 

printX2,pnmY2,tota]YDistanceTQMarker,niaxYAdjT>efined^nYAdjDefiiied; 
static float expectedYDistanccToMarker 

static int duml,duin2,adJDefined,tnitAcyustDist,flrstCalPatBitAcross,flm(^ 
30 numCaBttsCh\.nunxCaiBitsO£r,numCalPatBitsAcrDSS^gC^itOfi;avgCalBi 

numberWhitesAiound^numCalPatBitsDown^dataRow.caiibratelnRow; 

static int totalCalibrationBitsPerTile^dalaTileChedcsumSize; 

static int dataSeg,offsetDovm,ofiE5etAcross,no£ntries» bottomTile^genetous; 

static int pievMinEmpQ'Adj.prevMinEmpcylndex^tooHigh^prevPrevMinERiptyAdj; 
3 5 staUc char dummyflUarray [>nJh^ERBrrSDUMMYFlIX); static char * dununyfill; 
#definePOPUPINFO0 

static char szMess [100] ; 

noIntcfvals«NUMXINTERVALS; 

flilDununyFillArray(duminyfiUanay.flipEm) ; 
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miistl = memory StnicLmlistl; 

mUst2 ~ memoiyStnxctmiislI; 

mintlistl = tnemoiyStiuctiniiUlistl; 

inintlist2 = memoiyStnictmintlistl; 
5 hist memoryStructhist; 

hist 10 = mcmoiyStnict.histlO; 

resetTable - memoiyStructresetTable; 

XIndTable = memoiyStnict.XIndTable; 

YlndTablc « roemoiyStnxct.YlftcITablc; 
1 0 adjustList = memoiyStnict adjustUst; 

doseCallArray ~ memofyStructxloseCallArray; 

cioseCalllntensityAnay « memoiyStnictdaseCalUntensity Array; 

adjustlntensity Array - nieinoryStnict.adjustJntcnsity Array; 

doseCallList memoiyStiuctdoseCallList; 
15 erxorArraylmage = memoryStniderrorArraylmagc; 

works » mcmoiyStrua.workS; 
cotniineinpty=0; 

cnorI=0; 
20 if (hypothesis>0) 

if (highBitEnorRate) 

rcProccssHyp=*2; 

dse 

reProccssHyp-l; 

25 else 

reProcessHyp=0; 
#definc EhTOMINEMPTY ARRAY .999 
tfdefine NUMBERITEMS.PMEA 1 
prevMinEaiptyIndex=0; 
30 if(hypotlicsis>0){ 
for 

(i»K);i<200&&prcvMinEmptyArTay[il!=EhroMINEMPTYARRAY;i 
if (iHcvMiuEmptyArrayfi+l)"^) 
tooHigh«) ; 

35 dse 

tooHigh-0; 
prevMlii£mptylndex=^; 
} 

} 

51 



SUBSTITUTE SHEET (RULE 26) 



wo 97/32262 



PCT/US97/03330 



eJse 

prcvMinEmpty lndex»0 ; 
if (hypothcsis>0){ 

if (prevMinEmptyIndcx<2*haJMBERrrEMS_PMEA){ 
5 if(total2CTos>totaJOncs){ 

if (totalOnes=0||(lotalZcros/totaJOnes)>3) 

♦minemptyAdj=*rninemptyAdj-2*HYPOTHESISINCREMENT; 

else 

♦ininemptyAdj=* minempty Adj-HYPOTHESISINCREMENT; 

10 } 
else 

if (totalZeros=0||{totaJOncs/totalZcros)>3> 

•nuiicmptyAdj=*nuneinptyAdj+2*HYPOTHESISINCREMENT; 
15 else 

*nuncmptyAdj**ininemptyAdj+HYPOTHESISINCREMENT; 

) 

elsc{ 

prevMinEmptyAdj=prcvMinEmptyArray(prevMinEmptyIndcxJ ; 
20 prcvPrevMinEinptyAdj=prevMinEmpty Array [prevMi nEmptylndex- 

NUMBERITEMS_PMEA]; 

if (totalZcro5>tota]Oncs){ 

if(prevMiiiEniptyAdj>prevPrcvMinEinptyAdj) 

*iiiinemptyAdj=Kpiwh/UnEmptyAdj-»T)revPrevMinEinptyAdj)/2; 



25 cisc 



2*HYPOTHESISINCREMENT; 



if (lolalOnes«-0||(loialZcros/toialOncsP'3) 
*iniiieniptyAdj=*xnineiiiptyAdj- 



else 

3^ •minempty Adj=*mincmptyAdj- 

HYPCnUESISINCREMENT; 

My ) 
else 

if(prevMinEmptyAdj<prevPrevMinEmptyAdj) 
35 *rainemptyAdj«(prcvMinEmptyAdj+prevPrevMinEmptyAdj)/2; 

else 

if (lotalZcrt)s=0||(iotalOnes/toialZeros)>3) 

♦minempty Adj=*mincmptyAdj+2*HYPOTHESISINCREMENT; 
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else 



♦minemptyAdj^*mineraptyAdj+HYPOTHESISINCREMENT; 
} 

} 

if(hypothcsis>0){ 

pivvMiii£mplyAnray(prcvMinE]npiyliutex+KU\fBERIT^ 

prevMinEmptyAnay[prcvMiriEmptyIndex+2*haJMBERriBMS_PN^^ 

Y; 

} 

else{ 

prvvKfinEmplyAnay[prevMinEmptyIndex]=*imnernptyA(ij; 

prcvMinEmptyArray(piwMinEinptyIndcx+>IUMBERITEMS_^ 
) 

ifOeft==l){ 

xlncrKfloaO^stndteta; 
xInci«(float>-*avginvslopc; 
if (headcr){ 

t]uUaUzcVars(0,&spotlidght,&spoUeDgth,Jbiow5pennaikcr 

&nuinber5potsper5^&markerwidth, &iiiaTkcrbdgltt,&<iistanccbctwcciniiarlcci5dov^ 
AdistaiKd^etweenspotedges^&distaxicebeniivenrows^^ 

&noTilesDcivn,&noTUesAcn>ss>&5calciiiarldbeigh^ 
&bordei^dth,&leftznargiiiseg,&distaiuxbctweenbc^ 
&di5tanccinark]crcciitertospotcsntcr,&di5taiiccbet^^ 
&distaiioebetweenheaderspotsacross,&disUDcebet^ 
&head e rinarkcrwidUi>Ahcadennarkertieigfat,Adist^^ 
&header5poUength,&beaderspoUicight, ^numberheaderspotsperseg, 
&numberrowsdownHeader&xlisd>etlieadinarkedgespotedge. 

ftdistbetheadmaikcents); 
noHeaderCaUedChi'K>;noHeaderCa]ledOfiM);totaIHeaderCalled^ 
row5pennarker^2; 
if(scaleMarkPrcsexit){ 

teinpx^float)bouoinx-»-*costhela* 

(scaleinarkleiigth/4)'*'*pixiToPixp; 
tempy^float)bottoniy+*sintheta* 

(scaleinazklength/4)^*pixiToPuq); 
t(anpy— (floatX(floai)hcadennarkcrheight/2+ 1 )♦ *pixiToPixp; 
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} 

else{ 

tcinpx=(float)bott mx+^costheta* 
((float)distaiKxbetwccnbordcredgemarkeredge+(float)borderw 
pixiToPixp; 

tcinpy={float)bottomy+*siiiihcta* 
((float)cUstanccbctwecnbordc^edgCInaJ1ce^cdgc^<fl()at)b^ 
pixiToPixp; 

tempy-=(float)((float)hcadermarkerheight/2+l)**pixiTaPixp; 
) 

maxkcibotx«Kfloai)icmpx;markcitxitrKfloat)lempy; 
numFromTop=S;numbercUusegs*HiumbefdatasegmentsHe^^ 
distCoraerTol^stMark-distbetbeadmarkoents^numberd^ 
totalCalibrationBitsPerTileM);nimisp(>t5^umberbeadei^tspm 
expected YDistanceToMaikcF^ 
*costhcta*2*distancebctwecnheadcrroiwsdoivm**p^ 

generous^O; ♦adjustRatio=(*pixiToPixp)/EXPECTEDPIXrrOPIXPm 
} 

else{ 

setOataDcscriptorsFtoinHeader( headerlnfo.&duniiong. &spotheight,&spoUength, 
&row5perniaTker,&numbcrdatasegments,^umberspocsper5eg,&marker^ 

Adistancctoctwceiunaikersdown^ Adistanccbetwecnspotedges, 
& distancebetweeniowsdown.& 

distanccbetwecnxnaikeiedgcspotedge, 

&dbmese.&duinml2,&diixniiU2,&headeiType;&resoiuUo^^ 

AprinterTypc, 
&damTileChccksuinSi2e,&iediindancyLevelData); 

if(resolutionFactor=FRACnONCASEl) 

resfectfloat=VAUJEFRACnONCASEl; 
else if (resoliidonFactap«FRACnONCASE2) 

res£actfloat»VALUEFRACTIONCASE2; 

■~yr else 

resfac:tftoat=(floaOi'esolutionFacton 

numspots^numberspotsperseg; 
initializeVars(0^&5potheight,&5podength.&rowspennarker,&nuro 

&iiumberspoi$perseg,&inarkenvidth. &inaikerheight.&distancebetweeiiinaiker5down, 
&distanrytoweenspotedge$,j^staiiccbeh*renrowsdow^ 

&noTilesDown,&noTile$Acit>ss,&scalemai1cheight,&distancebetw^ 
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&bonlerwidth,&leftniargiiiseg,&distaiicebetweenborder^ 
&distaiK:cmarkercentertospotcenter,&distancebetweeiunark 
&4istancebetweenheaderspotsacTOSs, 

&distanc»betweenrowsdownheadennaTker5.&headermarkerwid 
&distancebetweenheaderrowsdown,&headerspoUen 
&nuinberheaderspotsperseg« 
&niimbcrrowsdownHeader,&distbetheaditiarkedges^ 
Adistbetheadmarkcenls); 

processCli>seCallAnay=l; 
spotToMarkcrAdjust=SPOTTOMAiaCFACTOR»(spocheight/2- 
inaikcrheight/2)**pixiToPbq); 

spotTQMarke^AdJust=SI<>TTO^MJUCFACTOR*(spoalCtght/2-ma^kerkeigh 

disUiK:ebetwcenspocsacn)ss°<distaiicebetweenspotedg^ 

distancemarkercentertospotoentci^ 

(markenvidth/2>+(spotlength/2.0Hdbmese: 
if((dbmese*»pixiToPixp<MINVERYGENEROUSTHRESH)|l 
((distanc^>etwecninarkersdown- 
inariccrhcight)»*pixiToPixp<3^«>rVSlY<3ENHlOU^ 
generous='2; 

else 

if ((dbmcsc*»pixiToPixp<NfINGENEROUSTHRESH)|| 
((distancebetwccnmaikcrsdown- 
raarkCThcight)**pixiToPixp<MINGENEROUSTHRESH)) 

genciDus^'l; 

else 

gcnccoiis^O; 
If ((primerType«LASER)&& 
((distaiioebetweenspotsacmss**|MxiTQPixp<MI^^ 

(dimncebetweciuowsdown**pixiToPixp<KlIN^^ 
xind*0; 

if ((primcrTypc™THERMAL)&& 
((distancebetwccnspotsacross**pixiToPixp<MIhnha)EX 
(distanoefaetwec nf Of w s a uwn**iwM 
xiiid«0; 

if ((primcrTypc>=INKJET>&& //this now covers all fax cases due to 
((distaiu:ebetween5potsaaDS5*^ixiToPixp<NfIhmaDEXTHRK 

(distaiicebctwcciuowsdown»»pixiToPixp<MIhahnDEXT^^ 

xind=0; 

initXInd(XIndTable, *pixiToPixp,(fioatK *costheta),nuinberspot5perseg, 
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distanceina]1cercxnteno5potcenter,distancebetwecnspotsacross,nolnu 
tcinpx'=(noat)bottomx+»costheta* ♦pixiToPixp* 
(((distancebfttwecnboTde^edgc^mke^edge^<boIde^wid 
tempy=(floai)bottomy+*siiithcta* *pixiToPixp* 
5 (((distancebetweenbonleicdgemarkeccdge^^borde^ 

majkcrt>otX"(float)tcmpx;inarkcrboty=Kfloat)tcmpy;niu^ 
nuniFromTop^NUKffROMTOP; 

numberdatasegs^numberdatasegments; 

distComcrToLastMark^distancebetweenniaikeiccmen* numbcidatascgs; 
10 expectedYDistaiic3eToMarker= 

*oostheta^((int)iowsperniarfcer)*distancebetweeiux)wsdown'^*pi //note this should be adjusted 

since it is VERTICAL 

calculateTotalCalibraUonBitsperTile(nuinberdatasegmentSpCalPatDescriptor5. noCalPaU 
AtotalCalibntionBitsPerTtle); 
IS calculateNumberlterationsNew<di5tancebetweenrowsdown» distancebetweemnatkersdown, 

numbeispotsperseg. numberdatasegments, iengthCodeWord, niunberDataBits^totalCalibrationBitsPerTile, 
niimberBitsData,&numberIterations); 
if|:lt0^9c) 

nuinbcrltcraiions-*-+; 

20 } 
} 

eise( 

tcmpx=(float)bottonix-*costheta* 

distancebetweenborderoentermarkercenter* ^pixiToPixp^ (float)res£actfloat; 
25 tempy=(float)boaonTyr-*sintheta* 

distancebetweenbordercxnlennarkercemer**pixiToPixp*(float)rcslactfloat; 
inaricerbotx==(noat)tempx-*5intheta*boideTtopi&dent*^i>dToPixp^(float)resf^^ 
mariccrboty«(float)tcmpy-(float)*cosiheta*bofdcitopindcnt**pixiToPi^ 
> 

30 bottoinTiieKtileI>own=noTilesDown-l); 
if(tq[>Tae){ 

if(leftTile){ 

fin dinai ke i comef(markcifaotx,inariceTfaoty/adJiistRaiio,lpDtbBits,hist, histlO. resetXable. 
minemptypixel.nuniFromTop,\viiidowsize,cxE>ib, cyDibJoorner, 
3S jimage^&maikerx, Amarkery, 

^pixiToPixp,xIncr,expectedYDistanceToMaikerXint)rDW5pennarker, 
&maxinten5ity, &inimntensity,&totaiinteiisity,top, left, header^&foundit); 

if (foundit){ 
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ifdscaicMaricPresenty/rcadjust based on found comer marker if scale mark not 

present 

*pixiToPixp= 

sqTt((roarkerx-bottoinx)»(markerx-bottomx)+(markery- 

5 bottomy)*(markery-bouomy))/ 

(floal)(distancebctwccnborderedgenarkcredge+bordcfwidth/2+hc^ 

if (header) //to comply with prevMarkerlntensity definition t 
scarchScgmenllxnglh-SEARCHSEGLENGTHNEXTMARKERHEADER; 
else 

10 scarchSegmentLcngth-SEARCHSEGIJBNGTHNEXTMARKERDATA; 

*prevMarkerIntensity^=findMarker]ntcnsity(lpDibBits,searchSegmentLeng^ 
markenc, inaikeiy,cxDib. cyDib, 
jcomer. Jimage.&dum l.&duin2); 

) 

15 } 
clsc( 

foundit^l; 

markcix»nghtMarker[0]; 
markery^ghlMarker( 1 ] ; 
20 maximenstty^rightMaikerlntensityCO]; 

> 

} 

else{ 

fotmdit=l; 

25 niaikenc^noinMarker5Sthp[tileAcfOSS*numberdatasegs*2-K)] ; 

niarkery=bottomMackersStnp[tileAcnis5*niiinbeniatasegs*2+l|^ 

maxiiitensity=bottomMarkerIntensity[tileAcross*nuinberdatasegs]; 

} 

oornenc=nuukenc;conieiy^inarkcTy;outiDd=0;*totalbits^; 
30 if(foundit){ 

roaikerlist I'^mlist l;inarkexifUlist 1 ^rointiist 1 ;inafkeftopx''=niarkerx;inarkenopy=markery; 

maikerimlist 1 [0]»inaxinteiisity; 

if(lcffrilc){ 

ii(noTiiesAcross*tileDown»S) 
35 bottomTile^^ttomTile; 

fiiidAllMaxkei5lnColumn(lpDibBits,hist, histlO, resetTable^nuraFromTop. 
inaikerx,niaikery,niaikcriist 1 ^narkerintlistl .numberlterations, windowsize. 
prevMarkerlntensity.O nt)rowspennarker,&nunibennarkers 1 ,&total YDistanceToMarker, 
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*pixiToPixp,xIncrxxpectedYDistanceToMarkcr,offsct,ocDiKcyDi^^ 

boitomTilc,gciicrous,hcadcr,&founditreProccssHyp,displayMarkcr,h^ 
if (numbemiarkers 1 >0&&foundit) { 

bottomMarkcrsStrip{ii le Across*niimbcrdaiasegs*2-K)l = 

markerlisti [numbcnnarkers 1*2-2] ; 
bottomMarkcrsStripf UlcAcrass*nuinbcrdatascgs*2+ 1 )« 

markerlisti [mimbennarkers 1 *2-l | ; 
bottomMaricerlnteiisity(UleAcross*iiuinbcrdatasegs]= 

marker! ist 1 (numbcnnarkers 1 - 1 ] ; 

} 

) 

else{ 

for (y=K)J=K)aj<*numbermaikcrsRighl*2uj+=2 

la5tx=rightMarker[ij];lasty^ghtMarker(ij+] I; 
markerlisti [ij]=lasix;markerlistl QH- 1 )«lasty; 
markcrintlist 1 [j]=nghtMarkerIntensityy]; 
) 




if(foundit){ 

prevnumbermarkers^niunbennaikers 1 ;bitnumbcrK);dumniyO=0;diiiiunyfill==dummyfUlarTay; 
if (noCalPais>0){ 

firstGalPatBitAcio$s*calPatDeschptors[0]; 
firstCalPatBitDown=calPatDescriptors[ 1 ] ; 
nuiiiCalPatBit5Acro5S=calPatDescriptors[2] ; 
numCalPatBitsX>own»calPatDescnptor5[3]; 
} 

clse( 

nr5tCalPatBitAciDss=0UiistCalFatBitDown=0; 

niunCalPatBitsAcro5s=0;numCalPatBitsDown«0; 

} 

^ calBitRowStart=l;noCto5eCalis=0;*totalbit5^; 
} 

if (leftTile&&topTile) 

• pixiToPixpLocal=*pixiToPixp; 
for (!=0;i<numbcrdatasegs&Aicmndit;i-H-){ 
pumpMessageO; 
if(tbContinxie){ 

return NULL; 
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) 

if (lopTile){ 

if (header) { 

niaikcrtx>tx=*costheta*distbetheadmarkcems* ♦pixiToPixpLocaH 
markertopx; 

markcibot>=*siitthcta*dislbetheadinarkccnts**pixiToPixpLocaK 
maikeitopy; 

> 

clsc{ 

inaiterboCx=*costheta*di5taJKebetweeiunaikercenters* ♦pixiToPixpLocal+ 

markertopx; 

n]arkerboty=*sintheta*distaiK:ebetweeiiinarkercentere**^^ 

markertopy; 

} 

findmiddlemarker(iiiarkertxKx,inaikerfooty/adju5UUtio,lpDi^^ 
hist, hist 10, 

resetTable,inineinptypixcl,numFromTop,windcm'size,cxDib,cyD^^ 

jcornerJiniagc;&markerx« 
&niarkciy,*pixjToPixp,xIiicr,cxpcacdYDistaiiceTc^larker, 

(im)rcw^permarker.*prevMai1ccrIntensity,&inaxinteiisity,&mini 
generous,top, header,&fouiidit); 

if (founditX 

measuredDist l=sqn((iiiafkenopx^iiarkerK)^ (markenopx-markeix^ 

(inarkertapfy-iiiaikeiy)*(inaikertopy-niarkery)); 
if (header) 

*pixiToPixpLocal^=ineasuredDist l/distbetheadmaikcents; 

cise 

*pixiToPixpLocal"measuredDisc l/distancebetweenmaikeicenters; 
maikertopx"markerx;niarkertopy=inarkeiy; 
prcvMarkerlntensityLoca]^ndMarkerInteiisity(lpDtt)Bics, 

seaichSegroentLcngth, markeix, markery, cxDib, cyDib, 

jcomerjimage; &dtmil. &duni2); 
*prcvMaricerIntensity»prevMarkerIntensityLocal ; 
} 

} 

else{ 

found] t»l; 

rnarkcrx==bot(omMarkcrsStrip(dlcAcross*numbcrdatascgs*2+<(i+ 1 )*2>+0] ; 
markery=bottomMarkersStrip[dlcAcross*niimbcrdatascgs*2+({i+l ) 
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maxintensity=%ottoinMaricerImciisity(UleAcross*numbercbtasegs^ I )] ; 
} 

if (foundiO{ 
lasUnarkerx^maikerx; 
5 lastmarkeiy^'inarkery; 
if(i%2=0){ 

markcrlisll^mlist 1 ;markcrUsa=rryist2;markcrintlistl«mintlisi 1 ;inarkcriniJist2==iiumlist2; 
> 

else{ 

10 maikerlisa==mlistl;maikerlUtl«=inlisa;inarkcrintUst2^ 
} 

niarkeriiitli5t2[0]^niaximensity; 

nndAllMarkersInColumnOpDibBits^hisu hist 10. rcsctTablcnumFromTop. 
markerx,nmkeiy,inafkcrUst2,markcrindisl2,niijnberlleraUons.windowim^ 
^ 5 prevMarkcrIntcnsity,(jnt)rowspcrniaiker^numbcnnarkers2 AtotaJYDi 

♦pixiToPixp,xlncr,expectedYDistanceTo\farker, 
offset, cxDib,cyDibJcomerjmiage,boaomTiIetgenerous, 

header.AJoimrih^iyJ>r nr 3 P^vHypirfe^^ 

if (nuinbennarkers2>0&&foundit)( 

20 bottoiiiMarkersStrip(tilcAcross*numbcKUtascgs*2-K(i+ 

inarkerlist2fnumbennaTkers2*2-2]; 
bottoinMarker5Strip[tileAcross'*<numben]atasegs*2'K(H- 1 )*2>+ 1 J= 

inarkerlist21iiunibcnnarka52*2-l ]; 
botton\MaikcrIntensity [tileAcros5*niimberdataseg5+(i+ 1)1= 
23 inarkcrlistl[nuinbennarker$2-l]; 
) 

if ((prevnumberfnarkere!=niimberinarkers2)I(!fouiidit) 
foimdit^; 

et5e{ 

30 initAdjustDist-O; 

if(adjiistDist){ 

initAdjustDist^'l; 

adjustListIiicF='2; 
35 #if ADJUSTDIST 

adjust VcrticalDistoftions(prevnunibennarkers, markeriistl,niarkerlist2, adjustUst, 
AxIncrAdj, &yIncrAdj.&inaxYAdjDcfincd, AminYAdjOcfmcd. 
markerlistlncr^adjustUslIncr); 

#eiidif 
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} 

if(topTile) 

inarkcrStaJt=0; 

else 

markerStart«2; 
if (processCloseCallArrayX 

rK>CloscCallsSegmeni=0;noCloscCallsSeginentOfifset=0 ; 
for(i=noCloscCallsScgmentOffsei;l<noCJoseCalIsScgmcntOffsct+(numspois^ 

closeCallArr3y(l]=l; 
/* the following entry of prevnumber etc. may depend on the ratio of markers to 

ataiDws */ 

noOoseCalls5egnientQfi5et'=(long)((prcvnuxnbcnnarkcrs- 
(markcrStart/2))+ 1 ) * (long)(numspots+2); 

for(l=noaoscCallsSegincntOfisci;l<noCloscCaiIsScgmcniOfisct+(ftumspots 
cioseCallArray[)]=l; 

> 

/* check calibration Urst, set thresholds */ 
if(noCaIPat5>0){ 

calBitRo\vStart» 1 ;totalIntCalBitOn=0;totalIntCalBitO£F=0; 
niimCalBitsOn«0;numCalBitsOfiM); 
for (ij=inarkerStartJ=niarkerStart/2,dataRow=0jj<^revniimbcnnarkers* 

jj+=2J++,dataRow++){ 
if <(noCalPai^)&&(dataRow >=fir5tCalPatBitDown>&& 
(dataRow<(fir5tCalPatBiiDovwi+iiiimCalPatBilsDown))) 
calibratelnRow^ 1 ; 

else 

calibrateInRow=0; 
if (calibratcInRow){ 

startx=maikcrlistl (ijj;starty=inarkeriistl [ij+ 1 ]; 

lastx»niarkerlist2[ij];lasty=inarkcriist2[iH-l); 
if( not_eqaal_real5(Usty » starty )) 

invslopc=(lasty-starty)/(lastx-stanx) ; 

else 

invslopcO.OOOOOOl ; 
if (header) 

else{ 

spotTQMarfcerAdjustScalcd=spolToMarkerAdjust**pixiToPixp; 

if (jJ<prcvnumbcnnarkers*2-2) 
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spotToMarker AdjustScalcd 

(starty-markcrlist 1 (ij+2+ 1 ] )/ 
((distancebetweenmarlccrsdown**pixiToPixp)/ 

(distan(xbetweeiimarkersdown/distanccbetweexm)Wsdow^ 
5 sULity=starty*spotToMarkerAdjustScaled: 

lasty^lasty 'SpotToMarker AdjustScaled ; 
if(xind)( 

ineasuredDi5t*fabs(startx-la5tx); 
incasuFedDi5t^rt((startx*lastx)*(5tartx-lastx)+ 
10 (starty-)asty)*(starty-Iasty)); 

expcctedDist==distancebctw«cninarkenxnters**pixiToPixp; v 

startx=startx+(ineasuredDist- 

cxpcctcdDist)*XINDADJ; 
lastx='lastx-<measuredDist-expecteaDi5t)*XIND AD J ; 
1 5 imerval'=(int)«startx-(int)startx)*noIntervals); 

imerlncr=0:inicrincr= l/(2*(float)nolniervals); 
inlcrval={int)(((startx- 

} 

20 #if ADJUSTDIST 

if (adjustDist) { 

imageCoordToPrintCoordCmarkerlistl , 
inaikerlist2, prcvnumbermarkere^ startx, starty, 
&pnntXI, &printYl, maxYAdjDefined, 
25 minYAdjDefined, xlncrAdj,yIncrAdj, 

markeriistlncr, &adjDefined); 
if (adjDcfincd) 

iinageCoordToPrinlCoord(inarkerlist 1 , 
inarkeriist2, prevnumbennaikers, iastx, 
30 lasty, &printX2, &printY2, 

niaxYAdjDefined* xninYAdJOefined, 
xIncrAdj,ylncrAdj, maricerlistlncr, 
&adpefniedX 
if (adjDefinedX 

3 5 5(artx»printX 1 ;starty=printYl ;lasix=T}rintX2;lasty=T>rinlY2; 

} 

} 

#endif 

} 

62 



SUBSTITUTE SHEET (RULE 26) 



wo 97/32262 PCTAJS97/03330 

decode(k}i5tripncw(staitx,5tarty,lastx,la5ty/pixiToPixpJpDibB 
memoryStnicCsavelt histpix,<X]ndTabI&^interval *(int)numberspot5perseg). 
dunimyfiUarray4ununyfilI,woi1iS^£uioHeaderCaUedOn,&noHeaderC^ 
&totalHea<terCalledOn,&totameadcrCa]ledO£r&noClc>seCallsSe^ 
5 &noCloseCall5,eiTorArniy»errorInd,&ent>rI,dataRaw,maxYAdjDe^^ 
minYAdjDcfined,yIncrAdj.adjusUJsUiicr,noIntcrvals,&^ 
jcorner, jiniage,minenipty,&biuiiimber, AdummyO, totalbits, totalKumCodeBits, 
1,-invslopcA 

header,neaniaghbor,xiTid,(adjustDist&&adjI>efined),laxFile; 
10 hypoUiesis. 1, /♦ peifonnCalibration is 1 ♦/ 

&calBitItewStait,&lotalIirtCamitChi.^biiiraCaffii^ 

pn>cessCI<>seCa]lAnray,ca]ibrateInRawJir5tCalPatBicAcross, 
numCalPa(BitsAcross.di5playSpots): 

} 

15 } 

if (numCalBitsOiPO) 

if (neameighborllxind) 
avgCAlBilQn^int)< tniflniii ralRHn n/n«fnPamitir<^ ): 

else 

20 avgCalBitOn=(im)(totalInlCalBilOn/(niiniCaIBitsOn*64)); 

if (numCalBitsOflPK)) 

if (nearneighboitlxind) 

avgCalBitOfi^taUntC^itOfiE^numCalBitsOfif; 

else 

25 avgCamitOffNcUalImCamitQfiD^(numCafflitsOfif*64); 

dataScgN; 

o£E5etDown«( (noTilesAcross* numbcrdatasegs) *tjieDown) *2; 
ofifsctAcross»(nuinbcrdaiascgs*tilcAcross*2); 
caIAvgArray[ofii5etDowiHt>ffi;etAcn)ss+^ 
30 cal AvgAiray [o£E5ea>own'f^se(Across'Klata^ 1 )=avgCalBitQflf; 

ininEinptySegnieiit-^jbratedMtnEinptyCcalAvgArTay. 
tiIeAcross.tileDown,dataSeg, ininEinptyMinErrors, 

noTilcsAcTOss^l^ilgQiTOnriMmfaCT da t as e g s ) ; 

} 

35 /♦ NOW look for dalal ♦/ 

for (u*markcrStartj=niarkcrStait/2 ,dataRowK>'Jj<prevnumbennarker5*2 j++,dataRow++) 
{ 

siartx^markcriistl [ij];starty=markcrlist I 1]; 
lastx=inaTkerlisa[y];lasty=inarkcrlist2[ij+l); 
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if( not_equaLreaJs(Iasty , starty )) 

jnvslopc^(lasty-starty)/(lasU-siartx) ; 

else 

invslope=0.0000001 ; 
il<automatic){ 

if((fabs(invslope)>0J)||((noClQseCalls>MAXCLOSECALLS)&& 
((float)noaoscCaUs/(floac)*totalbits)>MAXCU)SECAUJlATO^ 

xind^;neameighbor=0;bitinear=] ;adjustDist^ 1 ; 
ifdinitAdjustDistX 

initAdjustDist^ 1 ;markcrlistIncn«2;adjustListIncr=2; 

#if ADJUSTDIST 

adjust VerticalDistortionsCprcvnumbcnnarkers, markeiiist 1 , 
inarkerli5t2, adjustUst, AxIncrAdj, &yIncrAdJ, 
AmaxYAdjDefined, &minYAdJDefincd, * 
markerlisUncr^adjustListlncr); 

#cndif 

) 

> 

else ( 

xind- l;neanieighbor«l ;bilinear=0;adju$tDist^; 
} 

} 

minempty^markerintlist 1 (j)+iiiarkerintlisl2 0])/2; mincmpty— 5 ; 
if(header){ 

if (mineinpty>230)nunempty^230; 

mincmpty-* AD JMINEMPTYHEADER; /♦ because new pattern !♦/ 
) 

eise{ 

spolToMaiiccrAdjustScaled'spotT<^ilaikerAdjust**pixiToP^ 

if (ii<prevnumbennarkers*2-2) 

spotToMaikerAdjustScaled*= 

(slarty-markcriistl [ij+2+1])/ 
((distancebetweenmarkersdown ^pixiToPixp V 
(distancebetweemnarkei^own/distancebetwecnrowsdown)); 
siaity-starty-spoiToMarkcr Adjust Scaled; 
lasty-lasty-spotToMarkcrAdjusiScaled; 
if(xind){ 

measuredDi5t=fabs<startx-lastx); 
mcasurcdr>ist=sqrt«startx-lastx)*(stanx-lastx>+ 
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(starty-lasty)*(siany-lasty)); 
cxpecle(lDist=distaiK*bctweenmarkcix«ntm**pixiToPi^ 
startx=startx+<JneasuredDisi-cxpcctcdDi5t)*XINDADJ; 
Iastx=lastx-<mcasuredDist-cxpectedDist)*XIh^ 
iniervaHint)((startx-{iiit)staftx)*noIntervals); 
interIncr=0;interIncr=l/(2*(float)noIntCA^); 
iiUervaHint)(((startx-(mt)starU)+imerI ncr)* nolntervals); 
) 

if (mineropty>253)nunenipty»253; 

mincmpty— ADJMINEMPTY; /♦ because new pattern !*/ 

#if ADJUSTDIST 

if (a<|justDist) 
{ 

ixnageCoordToPrintCoordCmaricertistl, marker]tst2« 
prcvnumbcrmarkcrs, startx, starty, AprintXl. &printYI, 
maxYAdJDefined, niinYAdjDefified^ xlncrAdj, ylncrAdj, 
maricerlisUncr, Aadpefined); 

if'(adjDefine(0 

iinageCooidToPrintCoord(inaikerlistI^ inarkerUst2, 
prevnumbermarkcrs, lastx, lasty, &pnntX2, &printY2, 
maxYAdjDefined, minYAdjDefined, xlncrAdj, ylncrAdj, 
roaikerlisdncr, &adjl>efined); 

if (adjDefined) 
{ 

stanx^rintXl; 

stafty=printYl; 

la5tx»priiuX2; 

lasty*priiitY2; 

} 

} 

#endif 

> 

if ((noCaiPats>0)£&(dataR(nv >^m€^ 
(dataItow<<fimCalPatBitDown+namCalPatBitsDown))) 
calibrateInRow-1; 

else 

calibratelnRow>=0; 
if (noCalPats>0) 

inincnq>ty=nunEmptyScgmcnt; 
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if(header} 

mincmpty== miaemptypixel; 
miiiempty-t-=*iniiicinptyAdJ; 
if (rajncmpty>MAXMINEMPrY) 

mincmpty= MAXMINEMPTY; 
totraincmpty+=mincmpty;noEntries++; 
dcco<lcdotstripiiew(startx,starty.lastx,lasty.*pi^ 
mcmotyStnKa,saveIUhistpix,(XIndTabieH^ntcml*(int)numb^ 
dunmiyfillarray,dimunyfiU,workS.&noHeaderCalledOn,&rioHea(^ 
&totameaderCalledOn,&totalHeaderCailedOff;&noCtoscCalIsSegTO 
&noCloseCalls,errDrAiTay,errorInd,&«rTorI,dataRow,maxYAdjDefined, 
ininYAdjDcfincd,yIncrAdj,adjiisa.isdncr^olDtervals,&oudiKl,cxDib,^^ 

joonierJimage.minenipty,&bitnuinber, &duinniyO, 

loCalbitsaotaiKumCodeBits, 

l,-inv5lope,0, 

header,ncarneighbor.xmd,(adjustDist&&adjDefined),faxFilc, 

hypothesxs^O.&calBitRowStart^&totallatCalBitOn, &numCaIBitsOii, 
^ntftllmCalBitOH; &niiinCalBitsOfi;proces5CtoseCaIlArray, 
calibratclnRow,firstCalPatBitAcross»nimiCalPatBitsAcross,dis^ 
> 

if (processCloseCall Array) ( 

if (I header) /* should be invoked only if spots arc close together I */ 
{ 

setThreshholdsCloseCalls(numspots,(prevnunibcrinarkcrs-markerStart/2), 

dleDown,noTilesDown,ininempty,adjusUntensityArray,closeCallArTay. 

closeCallIntensityArray.(!neameighbor)); 
for (k=0;k<noClo5eCal>sSegment;k++){ 
instantRq)layaoseCalls(closcCallUst[k*CLOSELISTENTRYSIZE] . 
closeCalIUst(k*CLOSEUSTENTRYSIZE+ll. 
closcCaUList[k*CLOSEUSTENTRYSIZE+21. 
closcCallList[k*CLOSELISTENTRYSIZE+3l 
ctoseeaUList(k*CLOSELISTENTRYSIZE+4], 
closeCallList(k*CLOSELISTENTRYSIZE+5], 
closeCallList(k*CLOSEUSTENTRYSIZE+6], 
•nuncniptyAdj,niimspots,(prcvnuinbennarkers-niarkcrStart^ 
tilcDown,noTilesDown,distancebetwecnspotcdges, distancebctwecnrowsdown, 
distancebetwecninarkersdown,spothcighi,spotlength,*pixiToPi)cp, 

adjusllmensityArtay,closeCallArray,out); 
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> 

) 

> 

5 prevnumbermdrker5»numbermarkers2; 
> 

} 

} 

*foumlTile=foundit; 
10 if(!*f6uiidTiIc) 

*foundTilc=fouiicUt; /^ust for debugging 

else { 

if (noEntries>0) 

^avgminempty^ounincmpty/noEnuies; 
15 for (iH>J=<>U^<P'«vnuInbc^Ila^kc^s*2^j+=^ 
lastx«inarkerlist2Qj]; 
lasty=mailceriist2 1 ]; 
rightMaikerQj]«tastx; 
rightMarker[ij+l]=tasty; 
20 rightMarkerInteiksity(j]=^niaikerintlist20]; 

*nufnbennarkersRighc=nuinbertnarkers2 ; 

} 

newlm^lope=(lastinaikeiy-<x>niery>/(iastniarkerx-cornerx); 
if (£abs(newlitvslope)>0.000001) 
25 ; 
else 

newlnvslope=K).00000 1 ; 
a[vgorient<=atan(newInvslope); 

measuredI>istBetComerLastMaifc»5qn((cornerx-lastmark 
30 (<»niery-]astinarkery)*(coriieTy-la$Dnarkeiy}); 
if (header) { 

^pixiToPixpF^easuredDistBetC^rnerLasth^k/distComerToLascM^ 
*costheta--cos(avgoriem);*sintheta==sm(avgoricnQ;*a^^^ 
if (noHea<lerCa]ledO£r>0&AnoHeaderCa]tedOn>0){ 
35 *avgHcaderCaUedOnKim)(totafflcadcrCaUcdOn/noHeaderCallcdO^^ 

*avgHcadcrCaUedOflHimKtotaWcadcrCaIlcdOfl/noHraderCallcdOff); 

> 
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return 1; 

} 

If a nonrectangular spot has been defined, the center of that spot is preferably determined by looking 
5 to the ccntroid of the pixels of any such spot which might exist in a cell If a nonrectangular cell has been 
defined, the center is preferably found by locating the cell in a manner similar to locating the center of a 
rectangular cell, discussed above (including adjustments made for cells placed diagonally), adjusting such 
determination where the centroid pixel of any spot in such cell is expected (based on what is known about 
how the cells and spots were fonnatted) to be different from the center pixel otherwise determined. 

10 It should be understood that determining the centers of rows of possible spots and the centers of 

columns of possible spots can also be determined not by reference to the image pixel/printer pixel ratio but by 
reference to the ratios determined by dividing the number of rows or columns, as the case may be, that a 
particular row or colimin is displaced from a first reference marker by the total rows or columns, as the case 
may be, between markers. This ratio for each row or column is then multiplied by the lota 1 image pixel 

1 5 distance between markers to determine the image pixel displacement of each row or colunm from the 
reference markers. This method of determining the center of each row and each column performs most 
efilciently with an embodiment where there is no distance between markers and the nearest cells - i.e., the 
Marker to Spot parameter equals 0. For example, where the digitally encoded substrate is formatted and 
encoded such that there are 3 rows between markers (i.e.. Rows per Marker equals 3), the total image pixel 

20 distance betwera the top of a^first maaocr and the top of the next marker displaced vertically equals 2 1 , the 
lop of the first row of possible spots has the same vertical pixel coordinate as the top of the first marker, the 
image pixel distance between the top and bottom of each spot equals 6 and the vertical pixel image 
coordinate of the top of the first marker equals-L56, the centers of each of the 3 rows can be determined by 
multiplying 21 by the ratios 0:3, 1:3, aiKl 2:3, the products being 0, 7. and 14, and adding those products to 

25 1 59 (the vertical pixel coordinate of the top of the first marker plus 50% of the image pixel distance from the 
top to the bottom of each spot). Thus, the centers of the 3 rows would be at vertical image pixel coordinates 
159, 166, and 173. 

While the recovery process preferably determines the cemers of cells and the existence of spots 
through processes rendered by a computer from an electronic image of a dalatile, it should be understood that 

30 the recovery process can be employed without reference to an electronic image. Instead, the distina features 
of a datatile (e.g., markers and ^ts) are determined by measuring distances. Distances are preferably 
determined eittirely through automatic means (i.e., without any human intervention). In one such 
emhfxlim eiu^ai micrnyo|y gg grfediwitfa a-measuring^de^cc constitutes a mechanical means that 
automatically determines distance by sensing areas of differing reflectivity. Visual inspection of a datatile 

35 provides information from which to conclude the locations of datatile features such as landmarks, markers, 
cells, and spots, and these conclusions are then used to derive the series of digital data values which can, if 
appropriate, be used to manually derive some further information, such as text. Visual inspection follows the 
steps described iu FIG. 18, and generally follows that part of the process described by reference to FIG. 19 
that involves distances generally and not printer or image pixels or conversions of printer pixel coordinates 
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and distances (o image pixel coordinates and distances, it being understood that in a visual inspection 
embodiment there is no image of a datatile other than the printed datatiie itself, and determination of printer 
pixels (instead of actual maiicers, spots, etc.) by visuai inspection may be cumbersome and unnecessazy. A 
method of decoding employing measurement of distances enjoys many of the same benefits of the preferred 
5 embodiment, including use of the metasector to communicate the format parameters used for encoding. 

A visual inspection embodiment of the method of decoding preferably determines the lines through 
the centers of rows and columns by reference to actual distances, such as distances in microns. According to 
this embodiment, and assuming the top of the first row of possible spots next to a first maricer has the same 
vertical coordinate as the top of that first marker, the lines through the centers of rows are determined by 

10 first measuring the distance from the top of that first marker to the next marker displaced vertically and 
dividing that measurement by the number of known rows of cells between each marker and the next marker 
displaced vertically The result of this division is multiplied by the number of rows that a row is down from 
the first row next to the first marker. That product is then added to the sum ofonehalfthe spot height plus 
the vertical coordinate of the top of the first marker. If the assumption that the top of-the first row of possible 

15 spots has the same vertical coordinate as the top the first marker is invalid, appropriate adjustments are made 
for each row by adding the distance between the top of the first marker and the top of the first row of possible 
spots. 

Lines through the centers of the leftmost and righUnost colunuis are preferably determined ly visual 
inspection - through mechanical means locating the vertical centers of the top and bottom spots in each of 
20 those columns and drawing, physically or conceptually, a line through those spot centers. The hnes through 
the centers of columns in b^wcen the first arul last columns are determined by measuring the distance 
between the lines through the centers of the first column of possible spots and the last column of possible 
spots, dividing that distance by the result derived by subtracting one from the known number of columns 
between markers, and multiplying that product by the number of columns that each cohmui is horizontally 
25 displaced from the first colunm. The product from that multiplication indicates the distance that the line 
through the ccmer of each column is horizontally displaced from the center of the first column of possible 
spots. This system of determining colunm centers more accurately accounts for printing distortions. 

Determinations of the numbers of rows and columns known to exist between markers can be made 
cither through visual inspection by mechanical means or. preferably, by first decoding information conveyed 
30 by (he metasector. 

The visual inspection cmbodimcm as described in general above can be understood more 
particularly as foUowing a series of steps applied for each grouping of cells between markers. The steps 
below are applied to a datatile where a known number of rows exists between^thertOfpiofieadnmaikcHandnthe 
top of the next marker displaced vertically, and where a known number of columns exists between the left 
35 side of each marker and the left side of the next marker displaced horizontally, this knowledge being best 
conveyed by the metasector. 

1. Locate a first marker bordering a first grouping of contiguous cells, 

2. Determine the vertical coordinate of the top of the first marker. 

3. Locate a second marker being the nearest marker displaced vertically from the fim marker, 
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4. Measure the distance from the top of ihc first marker to the top of the first row of spots. 

5. Locale a third marker being the nearest marker displaced horizontally from the first marker. 

6. Determine the height of each spot. This knowledge may also be conveyed by the metasector. 

7. Determine the lines through the centers of each of the rows of cells by measuring the distance 
5 from the lop of the first marker to the top of the second marker^ dividing that distance by the 

nimiber of rows of cells known to exist between markers, and for each of the known nun^ of rtws, 
adding to the vertical coordinate of the top of the first marker the sum of one-half the height of each 
spot plus the distance from the top of the first marker to the lop of the spots in the first row. plus, for 
each row of cells, the product from multiplying the result of the division by the number of rows that 
10 that row of cells is vertically displaced from the first row of cells. 

8. Determine the lines through the centers of each of the columns of ceils by determining the lines 
through the centers of the rightmost and leftmost colunms of cells located between the first mariccr 
and the third markers, determining the horizontal coordinate of the line through the center of the 
leftmost column of cells, determining the distance between the lines through tKe centers of the 

15 rightmost and leftmost columns of cells between the first marker and the third marker, dividing that 

distance by the result derived by subtracting one from the number of columns known to exist 
between markers, and, for each column, nmltiplying the result of that division by the number of 
columns that the gntiimn^c^hmyftntgity-^fy^f^^ ^.fi^n ^ HThimn, and adding that 

product to the horizontal coordinate of the line through the center of the leftmost column of cells. 
20 ^. For each cell, determine the location of the ceil as being the intersection of the lines through the 

centers of the cell's corresponding row and column. 
Thus, the location of each cell located between each-set of mark^ (a set of markers being three markers - a 
marker and the next marker displaced vertically and the next marker di^laced h<Hizontally) can be 
determined through the above steps. These steps would be applied for each set of markers in the datatile. 
25 Having determined the locations of all cells, the method of decoding would then determine the contents of 
the cells to determine the series of digital data values. 

The above methodology can be applied to the enlarged portion of a digitally encoded substrate 
illustrated in FIG. 19. If, for example, the distance between the top of the first marker and the next marker 
displaced vertically equals 900 microns, that distance is divided by 3, the number of tows known to exist 
30 between markers, that ntmiber being known fay virtue of being oocnmunicated in the metasector. The result, 
300 microns, is multiplied by the number of rows that each row is down from the first row next to the first 
marker - i.e., 0 for the first row, 300 microns for the second row, and 600 microns for the third row. If each 
"^xrtiistoBwnito?haye?arhei;^t^ofg^Mcropsrtme4ialf i.e., 100 microns, is added to the 

products for each row to determine the distance that the lines through the centers of rtws are from the top of 
35 the first marker. Accordingly, the line 1908 through the center of the first row of possible spots is 100 
microns below the vertical coordinate for the top of the first marker. Line 1909 through the center of the 
second row of possible spots is 400 microns below the vertical coordinate of the top of the first marker. Line 
1911 through the center of the third row of possible spots is 700 microns below the vertical coordinate of the 
top of the first marker. 
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The embodiineiu then determines the lines through the centers of columns of possible spots. Visual 
inspection through mechanical means should determine the line 1910 through the center of the first column 
of possible spots and the line 1912 through the center of the last column of possible spots. If, for example, 
the distance between lines 1910 and J912 equals 5,600 microns^ that distance is divided by 14, the number of 
5 known columns between markers, 15, less one. The result of that division, 400 microns, is multiphed by the 
number of columns that each column is horizontally displaced from the fust column of possible spots. 
Accordingly, lines through (he centers of the first five columns of possible spots, for example, are 0, 400, 
800, 1,200, and 1,600 microns horizontally displaced from the line 1910 through the center of the first 
column of possible sp>ots. 

1 0 Other embodimenu of the method of decoding involving visual inspection determine the lines 

through the centers of possible rows and columns through other means. In one such embodiment, the centers 
are determined entirely by visual inspection - eg., by visually observing through mechanical means patterns 
of spots, the location of each cell is possible and determination of the presence or absence of a spot is thereby 
possible without measuhiig distances. 
15 The process above for recovering daU from a digitally encoded substrate, a portion of an exan4)le of 

which is illustrated in FIG. 19, assumes that cells have been formatted into horizontal rows and vertical 
columns and that the priruing and scanning processes produced little or no dcew. The recovery process of 
the preferred embodiment makes actiustments for diagonal formatting or unintended skew. Tiie recovay 
process makes such adjustments by determining the lines through the centers of rows of possible spots and 
20 the centers of columns of possible spots where both such lines are diagonal or skewed, expressed as having 
both vertical and horizontal displacements. The method of determining relative distances in printer pixels is 
the same as though no skew existed. These ratios are then applied to displacements between markers that are 
both vertical and horizonial. The line through the center of a row of possible spots is a diagonal or skewed 
line parallel to a line between the centers of a first marker and the next marker displaced primaiily 
25 horizontally, but partially verticaUy, The line through the cemcr of a column of possible spots would be a 
diagonal or skewed line parallel to a Une between the centers of a first marker and the next marker displaced 
primarily vertical^, but partially horizontally. In the case where cells are at perfect 45 degree angles to each 
other, the reooveiy process treats scries of cells as though occurring in rows and columns, where the lines 
through the centers of rows and columns have equal horizontal and vertical di^lacements. 
30 In a further embodiment, encryption and decryption may be integrated into the methods of encoding 

and decoding of the invention. FIG, 20 iUustrates the method of encoding of this fiirther embodiment Note 
that in one embodiment of the method of encoding, this would occur after the compression of the digital data 
(processing block 2003). Note that each of the processing blocks in FIG, 20 are performed as thcirTimilariy 
named counterparts in FIG. 2, with the exception of encryption processing block 2004. 
J5 In one embodiment, encryption is provided by cxdusive-ORing the initial data with a pseudo- 

random sequence generated using a secret key as a seed. Note that in this case, the decryption process (as 
described below) is simply exclusive-ORing the data with the same pseudo-ratKfom sequence. Note that this 
type of encryption process is not a perfecUy secure method of data cnciypUon because of the short key length 
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used 10 seed pseudo-random sequences and the fact that the same key is likely to be used on more than one 
message. There are well-known methods to attack this type of encryption. 

In order to obtain secure data through encryption, a one time pad can be employed in place of the 
pseudo-random sequence. A one time pad comprises a series of randomly generated bits that are known to 
5 both parties (i.e., the "cnciypting" party and the "decrypting" party) and is only used once in the cnciyption 
process. In a one time pad, the key length is equal to the message length and may be more than 100,000 bits. 
Since the one time pad is used once, it is not susceptible to the same attacks which are used on pseudo- 
random sequences. 

In another embodiment, encryption processing could be performed using the digital encryption 
10 standard (DBS) or the RSA algorithm In the RSA algorithm, digital data is encrypted using two prime 
numbers which are multiplied together, as is well-known in the art. It should be noted that any digi^ 
encryption method may be ett^loyed with the present invention. 

In the preferred embodiment, one method of encryption is used. In a further embodiment, the user 
can choose, as a further format parameter, from a variety of encryption methods. 
15 If encryption is integrated into the method of encoding, then decryption must be included in the 

method of decoding. One embodiment of the method of decoding of the present invention that inchides 
decryption is shown in FIG. 21. Note that each of the processing blocks in FIG 2 1 are performed in the same 

maimer as.their-rimiiM^ narnftri rnnnt^ip^r^^-in-F 1 ^-with4hr^y^?rrtT mi "fe'**^ '^^^ ' z^ *^ 

2 104. After error detection and correction, the data undergoes decryption (processing block 2 104). The 
20 decryption processing 2 104 is the inverse of the encryption applied in the method of encoding (FIG. 20). In 
one embodiment, the decryption process requires the use of the same key used during encryption. By using 
the same key, the original data is recreated. 

When the methods of cnciyption (and decryption) of the present tnverttion are being integrated into 
the methods of encoding and decoding, the present invention also provides data information to be transferred 
25 using plain paper in a maimer which preserves its privacy, authentication and/or limited accessibility. In the 
present invention, this privacy can easily be obtained through the use of a key or code known to the user(s) 
when encryption and decryption of a document occurs. Another useful application of the present invention is 
the authentication of a document Specifically, the present invention could be used to authenticate signatures 
on pE^ser documents or facsimile transmissions. A further use of the present invention is to limit access to a 
30 selected audience. Information could be widely published, as in, for example, newspapers or other mass 
media, with access limited to those designated to receive the secret key where such designation could occur 
before or after the encryption process. These keys could be distributed, for example, pursuant to 
subscriptions or some other iiiethod!ofiraising?revcnue: 

35 METHODS OF TRANSMimNG DIGITAL DATA 

FIG. 22 is a block diagram illustrating a method of transmitting digital data. A data source 
provides computer files or other digital data. The method of transmitting digital data selects format 
parameters (step 2201) for the formatting 2202 of the computer files or other digital data. Formatting 2202 
formats the computer files or other digital data into a series of digital data values and formats that series of 
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digital data values into a series of cells where each cell contains at least one bit of information from that 
series of digital data values. Fonnatting 2202 is done in accordance with the format parameters selected in 
step 2201. In the preferred embodiment formatting 2202 includes defining a cell size (i.e., width and 
height), and a ^t size (i.e., width and height), such sizes defined as pixels of the encoding device, whether 
5 a printer, a facsimile machine, a £ax/modem using facsimile software, or some other encoding device. The 
dimensions of a cell in the preferred embodiment arc at least as large as the corresponding dimensions of any 
spot that might occupy the cell. It should be understood that the details concerning the computer files or 
other digital data, selection of format parameters (step 2201), and fonnatting 2202, arc generally the same as 
the method of encoding described and illustrated above, including as described by reference to FIG. 2. 
10 Formatted digital data is then distributed, st^ 2203. The manner of distribntion may include any 

manner for the distribution of digital data in electronic or physical form. Embodiments of electronic 
distribution include facsimile, satellite transmission, telq)hoiiic transmission, cable transmission, and high 
speed line transmission (such as T I or ISDN). Embodiments of physical distribution include postal delivery, 
hand delivery, courier or other contract delivery service as wdl as any other means for moving the digitally 
1 S encoded substrate. In the case of physical distribution, the formatted digital data is first encoded onto a 
substrate, where the marmer of producing the substrate is as described above, including as illustrated in aiKi 
described by reference to FIG 2. 

Step 220 1 preferably selects format parameters optimal for the means of distribution used. Table 1 
(included at the end of this Description), provides values for format parameters for what are expected to be 
20 the most oorrunon methods of distribution utilizing personal computers for on both encoding and decoding. 

Transmission by facsimile machine typically requires larger spot and cell sizes than transmission by 
£eix modem. Where the maimer of distribution is more likely to introduce damage to the formatted digital 
data, format parameters should reflect larger spot and cell sizes than less damaging means of distribudon. 
Distribution by printing and physical distribution may require larger or smaller spot and cell sizes than 
25 electronic distribution, depending on the printer/scanner combination, the electronic distribution method or 
other facton. Thus, the selection of format parameters allows flexibility to consider not only the manner of 
encoding and decoding but also the maimer of distribution. 

Onct the formatted digital data is distributed, the redpient decodes that formatted digital data, step 
2204. The details of the decoding are as described above in the method of decoding, including as illustrated 
30 inanddescribedby reference to FIG. 16, 17, 18, and 19. In the case of pt^^ical distribution and in the case 
of &csimile tr ansm i ssi on to a facsimile machine, step 2204 of the prcfcired embodimem inchides first 
scanning the digitally encoded substrate to produce an image which is then decoded. In the case of electronic 
distribution of the formatted digital data, step 2204 of the preferred embodiment does not require an initial 
scan because the digital data is already in electronic form. In any case, step 2204 of the preferred 
35 embodimem decodes the fonnatted digital data firom an dectionic image of that formatted dig^ A 
preferred embodiment of decoding step 2204 is that method described by reference to and illustrated in FIG. 
17, 18, Biui 19, and, where formatted digital data has been placed on a substrate, FIG. 16. The result derived 
from aep 2204 is the original computer files or other digital data. 
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FIG. 23 illustrates in further detail the preferred embodiment of a method of transmitting digital 
data. The initial processes are similar to the steps illustrated in FIG. 22 and described above. The initial 
source of digital data is preferably computer files stored on the fixed disk drive of a personal computer, but 
could also be other sources of digital data such as a floppy disk, or another digitally encoded substrate. The 
5 computer files contemplated include data files not associated with any particular application soihvare. data 
files associated with a particular application software, and executable files, i.e.. files that perform functions 
once invoked. The method of transmitting digital data then provides for selection of format parameters, step 
2301, and formatting, step 2302, these steps being the same as those described as steps 2201 and 2202, 
above. 

10 The formatted digital data is then distributed (step 2303), The recipient of the digitally encoded 

substrate then subjects the digitally encoded substrate to decoding process 2304. Decoding process 2304, 
comparable to step 2204 discussed above, is as described in detail and illustrated above. 

The preferred eihbodiment of the method of transmitting digital data then determines (process stq> 
2305) whether the original digital data included a computer file designed to be run automatically following 
1 5 decoding. Whether a computer file is designed to be run automatically is a matter originally determined by 
the person creating the original file, quite possibly the person producing the formatted digital data. If it is an 
independently executable DOSAVindows® file (Windows is a product of Microsoft CorporaUon of Redmond, 
Washington), then it has a^iistina file iiame^ijarasion, such^as **:exe". F i i al iM M »» fierrfa u| iu ig ^rai t iia»at^ 
automatically executed if a flag in the header portion of the first datasector is so set. In the preferred 

20 embodiment, the person producing the formaned digital dau has the option to select setting of this flag. For 
example, the computer file may be communications software that activates the recipient computer's modem, 
places a telephone call to a pre*designated electronic bulletin board (orother remote computer such^ a 
network server or Internet service provider), establishes a connection between the recipient's computer and 
the electronic bulletin board (or other remote computer), and downloads a further computer file from the 

25 electronic bulletin board (or other remote computer) to the recipient's computer. 

If process step 2305 detennines that the original digital data includes a computer file designed to be 
run automatically, step 2306 commences execution of that computer file. Execution of the computer fUe may 
also follow or precede the storing on the recipient computer's fixed disk other computer files contained within 
the datatUe, possibly including files available for the automatically executed file. It should be understood that 

30 an application launched automatically may be stored and operated solely on the recipient's computer, or may 
be an application all or part of which invohws establishing conununication with other computers. Thus, for 
example, the application launched automatically may be a communications program that activates the 
recipient computer's modem to tciephoi»Taigemctfe-Lu niputei ait d- es t ablisli^a cunnecti ori^^ 
computer, and then turn control over to the recipient of the datatilc for further action. As a further example. 

35 a datatile corUains both a computer file of a document and instructions to automatically print the document 
on the primer attached to the recipient*s computer. Thus, the recipient gets a hardcopy printout of the 
underlying document through a minimum of efifort 

If, alternatively, the datatile does not include a computer file designed to be launched automatically, 
the method of transmitting digital data determines whether the datatile contains files associated with a 
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particular application (process step 2307). A file can be associated with a particular application when that 
file has been created by a particular application software or can be run by a particular application software. 
If the file is intended to be executed as input into an application, the appropriate application is also 
determined in Windows by the file name extension, along with standard mailings from extensions to 
5 applications (this mapping is stored in the win Jni file). For example, a file with the name "letter. wri** is 
typically assumed to be a Microsoft® Write document, as it ends with the extension **.wri", and that is 
usually mapped in win.ini to MiCTOSoft Write. Similar to the process for automatically executing a file, if a 
file is imended to be launched as part of an application, a flag in the header portion of the first datasector is 
set, with the setting preferably being selected by the user. For example, a word processing software package 
10 is an application software that creates files containing documenu. If that document file is associated with the 
word processing software and if the word processing software is pre-installed, choosing to open the document 
file actually launches the word processing software and then loads (le., opens within the word processing 
software for fimher processing) the document file. If the datatile contains a file associated with a particular 
application, and if the recipient's computer has that particular application software pre-installed, and if the 
15 recipient chooses to launch the application software (process step 2308) then step 2309 commences execution 
of the application software and loads the associated file contained in the datatile. Alternatively, the 
recipient's computer produces the original computer files or other digital data for purposes such as being 
stnnrd on ihe recipient computer's fixed disk. 

FIG. 24 is a block diagram of a further embodiment of the method of transmitting digital data, one 
20 which includes facsimile transmission. The data source can be computer files or other digital data. It should 
be understood that the nature of computer files or other digital data is not limited in scope and can include 
any source described previously for other embodiments such as files that can be launched automatically or 
files associated with a particular applicati<m software that can be launched automatically. The method of 
decoding then provides for selection of format parameters, step 240 1, and formatting, step 2402, these steps 
25 being the same as those described as steps 2201 and 2202, above. 

The present embodiment, contemplating transmission of digital data by facsimile transmission, then 
determines in step 2403 whether the person transmitting digital data transmits by facsimile machine or, 
alternatively, by ^x/modem conneaed to a computer. If the transmission is by fax/modem, the digital data 
as formatted in step 2402 is transmitted over a telephone line consistent with the method of transmitting any 
30 computer generated image by fax/modem. alternatively, the person transmitting digital data uses a £uc 
machine, the digital data formatted in step 2402 is printed omo a substrate, stq> 2404. That digitally 
encoded substrate is then processed in step 2405 through a fKsimile machine, the processing comprehending 
those same sub5tq»s exercised In any facsimile machine transmission: feeding the documeiu, in this instance 
the digitally encoded substrate, into the facsimile machine, emering the telephone number and causing the 
35 £icsimile machine to dial the inputted number. Whether by facsimile machine or through a fax/modem, the 
transmission sem over a telephone line is fundamentally the same - an image of a datatile one example of 
which is illustrated in FIG. 8, It should be rKHed, however, that minor differences might occur as a result of 
difterent format parameters. It should also be noted that a further embodiment comprehends, based on the 
sender's knowledge (or information available to the sender 's computer), determined in advance or 
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detennincd contemporaneously, of the rccipiott's currently activated equipment, the possibility of direct 
transmission of digital data from modem to modem. In those instances where possible and advantageous, 
this further embodiment employs direct modem to modem transmission in order to achieve transmission 
speeds faster than by facsimile transmission through a fax/modem. The digital data sent pursuant to this 
5 further embodiment is either the formatted digital data or the original computer files or other digital data. 

The image of formatted digital data having been sent by facsimile transmission, process step 2406 of 
the present embodiment then determines, at the recipient's caxL whether the redpiem receives facsimile 
transmissions by facsimile machine or. altemativeiy, through a fax/modem connected to a computer. If the 
recipient receives facsimile transmissions by fax machine, the formatted digital data as transmitted through 

10 the telephone line is printed by the facsimile machine, producing a digitally encoded substrate 2407. 
Digitally encoded substrate 2407 is then scaimed, process step 2408, using a scanner connected to a^ ' 
computing device capable of producing an image in electronic form of the digitally encoded substrate 2407 
(the scanner used for this purpose may include the fax machine itself where the fax machine first receives a 
transmission and prints the substrate and the recipient then feeds the substrate back through the fax machine 

1 5 sending an image of the substrate to a computer through the computer *s fax/modem). The image of the 
digital data, whether produced by facsimile machine and scanned into electronic form or instead received by 
fax/modem directly in electronic form, is decoded in step 2409, such decoding being as described and 
illustrated above, including the metluxl Ulustrated ta^nd-desccibedrby-reference to BGS^_i6,J7;.18>:a^ 
In the present embodiment the result of the decoding process 2409 is the reconstruction of the original 

20 computer files or other digital data. In further embodiments, the result is the automatic launching of 

executable files or the automatic launching of an application software with the transmitted file loaded within 
that application software, it being understood that the embodiment illustrated in FIG. 24 involves additional 
means of transmitting digital data that does not in any way limit what can be done with that digital data once 
decoded. 

25 In a further embodiment of a method of transmitting digital data incorporating the facsimile 

transmission in accordance with the method illustrated by FIG. 24, digital data is sent through a fax back 
system. In accordance with this embodiment, a person desiring to receive digital data telephones a number 
established by a person that desires to distribute the digital data. The person desiring to transmit digital data 
connects the telephone line to a £uc/modem coiuiected to a computer or other means capable of both receiving 

30 input from a touch tone telephone and then sending out a facsimile transmissioa The person desiring to 
receive digital data, having established a telephone connection, inputs information by use of touch tone 
td^hone signals, such information including, at a minimum, the facsimile number of the person desiring to 
receive digital data and, if a choice is available, the digxtal'data^destred.^^TheCTmpoter or other means 
capable of both receiving touch tone telephone input and transmitting facsimile transmission, then telephones 

35 (without further human intervention) the facsimile telephone number of the person desiring to receive digital 
data and estabUshes a facsimile coimection with the facsimile means of the person desiring digital data. 
Having established this facsimile connection, the computer or other means capable of both receiving touch 
tone telephone input and transmitting facsimile transmission, transmits an image of the formatted digital 
data in accordance with embodiments of the invention described previously. A similar embodiment employs 
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a fax-on-demand capability - the image of formatted digital data is transmitted by facsimile during the 
telephone call placed by the person desiring to receive digital data. 

In a further embodiment of the method of transmitting data, information recorded on a substrate 
includes digiul data as well as human readable information where the digital data includes one or both of 
S data needed to have the computer display appear the same or similar to the human readable information 
appearing on the substrate and data that causes information to appear on the computer display together with 
hyperlinks to further sources of information. FIG. 25 illustrates an example of a substrate and the process 
according to this embodiment. A paper substrate 2501 has printed upon it human readable text and graphics 
as well as encoded digital data. Paper substrate 2501 represents how the embodiment might be used for 

10 marketing purposes as in marketing flyers, advertising appearing in pritu media or other maikeiing 

materials. More particularly, the printed paper has three main components. First, at top, human readable 
text informs the reader of the purpose of the marketing material and the cozuents of the encoded digital data. 
Sccorul, in the middle of paper substrate 2501, surrounded by a dashed line, an entry form prompts the reader 
for the information needed to enter a contest. Third, at the bottom, a datatile 2502 incltkdes encoded digital 

15 data. 

The reader of paper substrate 2501 may then process (step 2503) the datatile. it being tmderstood 
that the reader may also proceed to enter the contest by manually completing the entry form as printed 
witli a ubUhCiofHCT gfflto^aiid without processing 2503 of the datatile. Processing 2503 includes the substeps 
of scamiing, decoding and nmning of the datatile, which substeps are as further described aiul illustrated 
20 aborve. 

Datatile 2502 in paper substrate 2501 would preferably include a computer file designed to be run 
automatically upon completion of the decoding process of the invention. The computer file could be 
composed using, for example, hypertext markup language (HTML). Datatile 2502, once scanned, produces 
an image 2504 on the computer display (e.g., 2504 represents a con^niter monitor with the image as the user 
25 would see it). Image 2504 has two primary components. First, image 2504 duplicates on the computer 
display the entry form appearing cm paper substrate 250 1. Datatile 2502 preferably contains or invokes word 
processing software allowing the reader to enter and edit thnnigh keyboard input the information needed to 
enter the contest Second, unage 2504 contains at its bottom a scries of "icons", delineated areas of the 
display which, if the user selects by click of a mouse or otherwise, causes the computer to comriKnce some 
30 further actioa The datatile is encoded with digital data that includes means for navigating to the subsets of 
information indicated by each icon illustrated in image 2504. In the instance of image 2504, there are 4 
icons. The first, labeled "CONTEST RULES", will, when selected by the user, cause the computer to erase 
the current image on the display and in its stead produce an image of the contest rules. The second, labeled 
"ACME COMP. DEALERS", will, when selected by the user, cause the computer to erase the currem image 
on the display and in its stead place an image of a list of Acme computer dealers on the display. The third, 
labeled "FAX ENTRY FORM", will, when selected by the user, cause the computer to activate its fax/modem 
and send a fecsimile transmission of an image of the entry form appearing on the display, as altered by the 
user with keyboard input The fourth, labeled "PRESIDENTS VIDEO CLIP", will, when selected by the 
user, cause the computer to erase the current image on the display and in its stead commence a video clip on 
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the display. Thus, FIG. 25 illustzatcs an cmbodiincnt including both automatic links to further sources of 
data and -reverse WYSIWYG" - i.e., instead of printing on paper the image appearing on a computer display 
(What You See Is What You Get), the image printed on paper appears on the computer's display. This 
feature is accomplished by virtue of the datatile being encoded with instructions such that di^laying means 
5 will display an image oorapaiable to the human readable information printed on substrate 250 1 . 

It should be understood that the digital data of each underlying icon application may derive from the 
datatile, from some other source including other digitally encoded substrates, remote computers connected 
telephonically by modem, compact disks, hard disk, floppy disk^ or from a combination of the datatile and 
another source. For example, referring back to FIG. 25, selecting "CONTEST RULES'* may cause the 

10 con^iuter to produce on its display a list of contest rules derived from the datatile v^lt selecting 

"PRESIDENTS VIDEO CLIP* may cause the computer to access a video dip from a compact disk, or to 
instead search for and access the video clip from various alternative sources - for example, first determining 
whether the video clip exists on the computer's hard disk, looking next on a compact disk, then invcridng 
telephonic communication with an online service, bulletin board, an internal or external network or the 

15 Internet, accessing the video clip from the first available source. In one embodiment uniform resource 
locators (URLs) arc used in the instructions directing the computer to access digital data. 

It should be further utKlctstood that because the invention acts as a chaimel for digital 
communication the ability to link the printed page to the electronic wor^d-canrbetaccomplishedrinrany 
manner in which instructions can be digitized. Thus, while FIG. 25 illustrates the use of icons, automatic 

20 links to further data sources can also occur through hypertext - i.e., specially formatted text which when 
selected by the click of a mouse button causes a jtunp to some further source of data. Also, HTML is just one 
method known to those skilled in prograiiuning for accomplishing the linking of paper to the electronic 
worid. Other methods include the object linking and embedding COLE**) facility of Windows® Version 3. 1 
produced by Microsoft Corporation of Redmond, Washington and the facility of Microsoft Plus® for 

25 Windows 95® to place an icon in a document which, when selected by click of a mouse buttoiv automatically 
activates the host computer's modem and Internet access software, calls and establishes contact with the host 
computer's Internet access provider, and navigates to the URL specified for the icon (i.e., the URL specified 
by the person creating the icon for the document). 

The linking of paper with the electronic world is preferably accomplished using the methods of 

30 encoding and decoding descril>ed above. These methods of encoding and decoding make the linking feasible 
due to nnany of the unique and advaiuageous features including the density of data possible and the wide 
range of acceptable printers and. more importantly, acceptable off-the-shelf scanning devices. 

It should be further understood that while the invention serves as a link between paper and'tbe 
electronic worlds the electronic cormection can also be just a digital path to an analog source. For example, 

35 the digital data can include a way of navigating, a priori, through a voice mail system where the digital data 
includes a company's main telephone numtwr, a directoiy of employees of a company, the particular 
telephone extensions for each of those employees and computer instmctions to activate a calling device (such 
as a modem) place a telephone call to the company's main mmit)er and navigate through the company's 
voice mail system to the telq[)hoiie of the employee selected by the user before the call is made. By decoding 
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the digital data, activating the program contained in the digital data, and making a selection of employee^ the 
user can avoid the usual time consuming method of navigating a company's voice mail system. The miethod 
is especially advantageous for subsequent calls to the same company because the digital data would 
presumabb' be stored on hard disk after decoding. Thus, the digital data serves as a link between two analog 
5 sources - the user and the company employee. 
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SH Spot Height in pixels 

S W Spot Width in pixels 

CH Cell Height in pixels 

CW Cell Width in pixels 

MH Marker Height in pixels 

NfW Marker Width in pixels 

MTS Marker to Spot in pixels 



SPS Spots per Segment 

RPM Rows per Marker 

DS Data Segments 

DA Datasectors Across 

DD Datasectors Down 

flat/hand for flatbed or hanheld ' 

fax/sheetfed for sheetfed or fax machine as scanner 
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We daim: 

1. A method of encoding data on a substrate as digital data comprising: 

fonnatting the data into a series of digital data values wherein said series of digital data values are 
fonnatted into a pattern consisting of a plurality of spaces at least some of which have dimensions M pixels 
5 by N pixels wherein at least one bit in said series of digital data values are represented in each of said 

plurality of spaces where at least one logical state is expressed by the presence in the ^ce <rf a spot of a spot 
si2C with dimensions X pixels by Y pixels and at least one other logical state is expressed by the absence of a 
spot with dimensions X pixels by Y pixels from the space and where at least one of M, N» X, and Y may be 
any of a plurality of sizes irrespective of at least one other of the dimensions H N. X, and Y, and 
10 outputting said pattern onto at least one substrate, such that the data is represented in digitized form 

on said at least one substrate. 

2. The method of encoding data of claim 1 wherein said formatting formats said series of digital data values 
into said plurality of spaces wherein a plurality of bits in said series of digital data vahies arc represented in 

1 5 each of said plurality of spaces where a plurality of logical states are expressed by a plurality of colors for a 
spot which the space may contain where each color represents a diflfercni logical state for said space. 

3. ThrT ™^>*^ "^ ^"^i tfTF^far^ p^'^^'^y of colors consists of a plurality of shades of 
gray. 

20 

4. The method of encoding data of claim I wherein a plurality of ^>ace sizes are defined 

5. The method of encoding data of daim 1 wherein a plurality of spot sizes are defined. 

25 6. The method of encoding data of claim 5 with at least one plurality of spot sizes and at least one space size 
and where all spaces of said at least one space size may contain a spot of a spot size from one of said at least 
one phirality of spot sizes, and wherein said series of digital data values are formatted into a plurality of 
spaces of the space size wherein each space represents a plurality of bits in said series of digital data values 
where one logicai state is expressed by the absence of a qwt from the space and where fuit^ 

30 arcreptesentedbytheptcscnccofspotsof the various spot sizes in the space where a spot of each spot size 
in the space represents a fkirther logical state. 

7rThrmetfaod'Ofeiioodingilata'of daim 5 wherein at least one bit in said series of digital data values is 
represented in each of said phirality of spaces where one logical state is expressed by the presence of a spot of 
35 one spot size and at least orke other logical state is expressed by the presence of a spot with a size different 
fipom a spot expressing the first logical state. 

S. The method of encoding data of claim I with at least one plurality of spot sizes and at least one space size 
and where all spaces of a particular size may contain a spot of a spot size firom one of said at least one 
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plurality of spot sizes, and wherein said series of digital data values are formatted into a plurality of spaces of 
said particular size wherein each space represents a plurality of bits in said series of digital data values where 
one logical state is expressed by the absence of a spot from the space and where further logical states are 
rq>resented by the presence of spots of various spot sizes and colors in the space where a distina logical state 
S is represented by a spot of each combination of color and size. 

9. The method of encoding data of claim 1 wherein said series of digital data values are formaned into at 
least one grouping of contiguous cells placed at a predefined location relative to a landmark, whereby the 
location of said at least one grouping of contiguous cells can be determined by reference to the location of 
10 said landmark' and where the spaces of said at least one grouping of contiguous spaces are formatted into a 
plurality of contiguous rows and a plurality of contiguous columns and where at least one series of markers 
borders said at least one grouping of contiguoiis spaces on at least one side, v/herdby the location of the rows 
or columns of spaces can be determined by reference to the markers. 

15 10. The method of encoding data of claim 9 wherein said series of digital data values are formatted into a 
pattern with a plurality of groupings of contiguous spaces. 

11. A system of encoding data on a substrate as digital data comprising 

selecting means for selecting at least one value for at least one format parameter from a plurality of 

20 values for the parameter, 

formatting means coupled to the selecting means for formatting the data imo a series of digital data 
values wherein the series of digital data values are formatted into a plurality of cells at least some of which 
have a cell size with dimensions M pixels wide by N pixels high where if a value has been seleaed for a 
format parameter determining the width of a cell then M is defined as equaling the value so selected, arui 

25 where if a value has been selected for a format parameter determining the height of the cell then N is defined 
as equaling the value so selected, wherein each cell represents at least one bit in the series of digital data 
values where at least one logical state is expressed by the presence of a spot with a spot size with dimensions 
X pixels wide by Y pixels high, where if a value has been selected for a format parameter determining the 
width of a spot then X is defined as equaling the value so selected and where if a value has been selected for 

30 a format parameter determining the height of a spot then Y is defined as equaling the value so selected and at 
least one other logical state is expressed by the absence of a spot of said spot size in the cell and wherein said 
formatting is done in accordance with such other values for format parameters as have been selected, and 

outputting means coupled to the formatting means for outputting said plurality of cells onto at least 
one substrate, such that the data is represented in digitized form onto said at least one substrate. 

35 

12. The system of encoding data of claim 1 1 where the selecting means selects values from pluralities of 
values for at least one format parameter determining at least one dimension of at least one cell size, for at 
least one format parameter determining at least one dimension of at least one spot size, and for at least one 
format parameter selected from the group consisting of the width of at least one marker, the height of at least 
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one marker, the distance of markers from cells and the distance of markers from each other, and where the 
formatting means formats said series of digital data values into said plurality of cells with at least one 
grouping of contiguous cdis where said at least one grouping of contiguous cells are formatted into a 
plurality of contiguous rows and a plurality of contiguous columns and where at least one series of markers 
5 borders said at least one grouping of contiguous cdls on at least one side, and where said formatting is done 
in accordance with the values selected. 

13. The system of encoding data of claim 1 1 where the selecting means consists of inputting means for 
inputting said at least one value for said at least one format parameto- from a plurality of values whereby the 

10 user is provided the ability to alter the manner in which the series of digital data values becomes formatted 
into said plurality of cells. 

14. The system of encoding data of claim 1 1 where the selecting means selects said at least one value for said 
at least one format parameter from information available without user input. 

15 

15. The system of encoding data of claim 1 1 where the selecting means includes inputting means for 
inputting information where the selecting means selects said at least one value for said at least one format 
parameter from a^piurahty^ofevahics bagrf-m-lr?Kf%i parnonittefl ininmed from the inputting 
means. 

20 

16. The system of encoding data ctf claim 1 1 where the selecting means includes inputting means for 
inputting said at least one value for said at least one fomna parameter from a phirality of values and where 
the selecting means selects values for any remaining format parameters first from available information and 
then based on de&ull values. 

25 

17. The system of encoding data of claim 16 where, 

the selecting means includes inputting means for inputting values for format parameters 
establishing said dimensions M pixels wide by N pixels high for said at least one cell size, for format 
parameters establishing said dimensions X pixels wide by Y pixels high for said at least one spot si2e, for 

30 fbnnat parameters establishing the dimensions of at least one marker size, the distance of markers from cells, 
the distance of maikers from each other, the type of printer utilized by said encoding means for encoding said 
phuality of cells onto said at least one substrate, the number of datasectors across, where a datasector is the 
smalles t g tu upiu g of cells cap^ieoftldivcring^oomplete message after applying error detection and 
correction, the number of datasectors down, the number of segments across, where a segment represents a 

35 row of cells between two columns of maikers, and the number of spots per segment, and where, 

the formatting means formats said series of digital data values into said plurality of cells with at 
least one grouping of contiguous cells where said at least one grouping of contiguous cells are formatted imo 
a plurality of contiguous rows and a plurality of contiguous columns and where two cohmms of markers 
border said at least one grouping of contiguous cells on two sides, where the markers are formatted according 
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to the format parameters selected that establish the dimensions of at least one marker size, the distance of 
markers from cells, the distance of markers from each other, and where all such groupings of contiguous 
cells fonn a main body of data and where the formatting means further formats said plurality of cells into the 
number of datascctors determined by the formal parameters establishing the number of dalasectors down and 
5 the number of datasectors across where each datasector consists of at least one segroem down and at least one 
segment across with the number of segments across determined by the format parameter establishing the 
number of segments across, and where each segment consists of a plurality of cells across with the immber of 
cells across determined by the format parameter establishing the number of spots per segment, and where the 
formatting means formats adjacent to said at least one grouping of contiguous cells a metasector consisting of 
10 a plurality of cells wherein each cell of said metasector represents at least one bit in a series of bits 
representing the digital data values expressing the values selected for the format parameters whereby 
information contained in said metaseaor can be used to decode the data contained in the at least one 
grouping of contiguous cells. 

15 18. The system of encoding data of claim 1 1 where the dimensions M and N define a noiuectangular shape 
and where the formatting means formats at least one plurality of cells into said nonrectangular shape of 
dimensions M and N. 

19. The system of encoding data of claim 1 1 where the dimensions X and Y define a noiuectangular shape 
20 and where the formatting means formats at least one pltmUity of spots into said nonrectangular shape of 

dimensions X and Y. 

20. A method of decoding digital data values formatted into a pattern comprising the steps of: 

determining the locations of cells in a first grouping of contiguous cells where the grouping of 
25 contiguous cells contains digital data indicating information concerning the formatting of a plurality of the 
remaining cells in said pattern, 

deriving from said first grouping of contiguous cells said information concerning the formatting of a 
pattern of a plurality of the remaining cells in said pattern, where the deriving conQ)rises extracting digital 
data fom each cell wherein each cell contains at least one bit of data where one logical sute is expressed by 
30 the presence in the cell of a spot with one set of attributes and at least one other logical state is expressed hy 
the absence iiom the cell of a spot with the same set of attributes as a spot the presence of which expresses 
the first logical state, 

determining the locatiorts of said plurality of the remaining cells in said pattern, where said st^ of 
determining locations is performed by reference to and use of at least some of said information concenung 
35 the formatting of a plurality of the remaining cells in said pattern, 

deriving digital data values from said plurality of the remaining cells in said pattern where the 
deriving comprises extracting digital data from each cell wherein each cell contains at least one bit of data 
where one logical state is expressed by the presence of a spot with one set of attributes and at least one other 
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logical state is expressed by the absence from the cell of a spot with the same set of attiibutes as a spot the 
presence of which expresses the first logical state, whereby digital data is recovered from said pattern. 

21. The method of decoding of claim 20 where the cells of said first grouping of contiguous cclis arc 
5 fonnatted into a plurality of contiguous rows and a plurahty of contiguous columns and the cells of said 
plurality of the remaining cells in said pattern are formatted into a plurality of contiguous rows and a 
plurality of contiguous columns and where at least one series of markers borders on at least one side of said 
first grouping of contiguous ocUs and on at least one side of said plurality of the remaining cells in said 
pattern and where the steps of determining locations of cells in said pattern is performed by reference to and 
10 use of the markers. 



22. The method of decoding of claim 21 where all cells are formatted into groupings of contiguous cells and 
encoded onto a substrate and each grouping of contiguous cells is formatted into a plurality of contiguous 
rows and a plurality <^ contiguous columns, and where series of markers border each grouping of contiguous 
15 cells on at least two sides, and where a known number of rows cxisu between the top of each marker and the 
top of the next marker displaced vertically, and where a known rumiber of columns exists between the left 
side of each marker and the left side of the next marker displaced horizontally, and where determining 
if^tio!« of cglls on^hc <fic*tfl*^y-^*K^M- y''*'ytn 't^^ 

markers comprising the steps, applied for each grouping of cells between markersrof: 
20 locating a first maricer bordering a first grouping of contiguous cdls, 

determining the vertical coordinate of the lop of said first marker, 

locating a second marker being the nearest marker displaced ventcaUy &om'said first maricer, 
determining the distance from the top of said first marker to the top of the first row of spots, 
locating a third marker being the nearest marker displaced horizontally from said first marker, 
25 determitung the height of each spot, 

determining the lines through the ceruers of each of the rows of cells by determining the distance 
fiom the top of said first marker to the tc^ of said second marker, dividing that distance by the number of 
rows of cclU kXK>wn to exist between inarkers, and for each of the known nuinbcr of row^ 
vertical coordinate of the top of said first marker the sum of one-half the height of each spot plus the distance 
30 horn the top of said first marker to the top of the spots in the first row, plus, for each row of cells, the 

product fiom multiplying the result of the division by the number of rows said each row of cells is vertically 
displaced fiom the first row of cells, 

rieye rminmg^ 1he?ltngirthmngh-the^«nt«x^cifee gtA o 

through the centers of the rightmost and leftmost columns of cells located between said fu^ marker aiul said 
35 third itkarkers,determinii&g the horizoiital coordinate of the litiethnmgh the cexuer^ 

cells, determining the distance bet w e en the lines through the centers of the rightmost and leftmost colimms 
of cells between said first marker and said third marker, dividing that distance by the result derived by 
subtracting one fiom the number of columns known to exist between markers, and. for each column, 
multiplying the result of that division by the number of columns that said each column is horizontally 
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displaced from the leftmost column, and adding that product to the horizontal coordinate of the line through 
the center of the leftmost column of cells, and 

for each cell, determining the location of the cell to be the intersection of the lines through the 
centers of the cell's corresponding row and column. 

5 

23, The method of decoding of claim 21 where all cells are formatted into groupings of contiguous cells and 
encoded onto a substrate and where each grouping of contiguous cells is formatted into a plurality of 
contiguous rows and a plurality of contiguous columns, and where scries of markers border said each 
grouping of contiguous cells on at least two sides, and where, 
10 foresaid each grouping of contiguous cells, 

a known number of printer pixels separates the markers from the edges of possible spots, 
a known number of rows exists between the top of each marker and the top of the next 
marker displaced vertically, 

a known number of columns exists between the right side of each marker and the left side 
15 of the next marker displaced horizontally, 

each cell has the same height and width, 
each spot has the same height and width, 

t he-venkal printer pixel coordinates for the top of a marker and the top of the spots in the 
nearest row are equal, 

20 and where said first grouping of contiguous cells contains information concerning the encoding of 

the remaining cells on the digitally encoded substrate where the information includes, 
the marker, spot, and cell widths and heights measured in priruer pixels, 
the value of the known rmmber of printer pixels that horizontally separates the markers 
from the edges of possible spots in the nearest columns, 
25 the value of said kikown number of rows, 

the value of said known number of oolunms, 
and where the method of decoding further comprises creating an image of the digitally encoded 
substrate where the various parts of said image can be measured in image pixels and the locations of 
the various parts can be referenced by horizontal and vertical image pixel coordinates, and where 
30 the steps of locating cells on the digiully encoded substrate, applied for each grouping of contiguous 

cells located between markers, comprise: 

locating a first marker bordering a first grouping of contiguous ceils, 
determining the image pixel coordinates of the center of said first maricer, 
determining the image pixel coordinates of the top of said first marker, 
35 locating a second marker being the nearest marker diq^laced vertically from said first 

marker, 

determining the image pixel coordinates of the center of said second marker, 
locating a third maricer being the nearest maricer displaced horizontally from said 
said first marker, 
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determining the line through the center of each of the rows of cells between said first 
marker and said second marker by: 

determining the distance in image pixels from the center of said first marker to the 
center of said second marker, 
5 determining the printer pixels vertically separating the centers of said first marker 

and said second marker by multiplying the value for the known number of rows by the 
printer pixel cell height, 

determining for each of the known number of rows the printer pixel vettkal 
distance from the center of said first marker to the line tluough the center of the row by 
10 subtracting one-half <^ the printer pixel marker height firom the sum of one-half the printer 

pixel spot height plus the product derived from multiplying the printer pixel cell height by 
the number of rows that the row is displaced fom the top row between said first marker 
and said second marker, 

determining for each of said known number of rows a ratio Of printer pixels that 
15 the line through the center of that row is vertically displaced from the center of said first 

marker to said printer pixels vertically separating the centers of said first marker and said 
second marker, 

for«ach rowradding to the-vertical imageipBcel coor ri in ateiofi thexci i iri^ AilUaML 
first maricer the product from multiplying the distance in image pixels fix>m the center of 
20 said first marker to the center of said second marker by said ratio of primer pixels that the 

line through the center of that row is vertically displaced from the center of said first 
marker to said printer pixels vertically separating the centers of said firstmarko' and said 
second marker, 

determining the lines through the centers of each of the columns of cells by 
25 determining the Hi<fftnr#> in image pixels from tiie center of said first marker to the 

center of said third marker, 

determining the printer pixels horizontally separating the centers of said first 
marker and said third marker by determining the sum of the printer pixel marker width, 
phis the known printer pixel distance horizontally separating said first marker and the 
30 nearest edges of possil>]e spots in the nearest column to the right of said first cohmm, plus 

the printer pixel spot width, plus the product derived from multiplying the cell width by the 
result derived from reducing by one said value for said known number of columns, plus the 

known printer pixel Hicra np!ft ^h nri y nn rat1y^ ^J !| iM i ^lii ig;KaTrftririTrismaiicg^^ 

edges of possible spots in the nearest column to the left of said third marker, 
3 5 determining for each of the known rmmber of columns the printer pixel horizontal 

distance from the center of said first marker to the line through the center of the column by 
determining the sum of half the printer pixel marker width, plus the known printer pixel 
distance horizontally separating said first marker and the nearest edges of possible spots in 
the nearest column to the right of said first marker, plus half the printer pixel spot width, 
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plus the produrt derived from multiplying the printer pixel cell width by the number of 
cohmms chat the column is horizontally displaced from the nearest column to the right of 
said first marker, 

determining for each of said known number of columns a ratio of primer pixels 
5 that the line through the cemer of that column is horizontally displaced from the center of 

said first marker to said printer pixels horizontally separating the centers of said first 
marker and said third marker, 

for each column, adding to the horizontal image pixel coordinate of the center of 
said first marker the product from multiplying the distance in image pixels from the center 
o*^ said first marker to the center of said third marker by said ratio of printer pixels that the 
line through the center of that column is horizontally displaced from the center of said first 
marlcer to said printer pixels horizontally separating the centers of said first marker and 
said third marker, and 

for each ccll» determining the location of the cell to be the imeisectioa of the lines through 
15 the center of the oeU's corresponding row and column. 

24. The method of decoding of claim 20 wherein said pattern is encoded on a substrate and where said 
sifeu^alcibrtfaeiECDnaqHaBs^^hi^^ steps of the method of decoding further comprise an 
initial step of locating said landmark and wherein the step of detcnniiung the locations of said first grouping 

20 ofcontiguous cells is performed by reference to the location of said landmark. 

25. The method of decoding of daim 20 wherein said digital data values are encoded onto a plurality of 
substrates and wherein saidmethod of decoding fiirther comprises a step of locating each of the groupings of 
cells on each of said plurality of substrates wherein the steps of determining the locations of cells and 

25 deriving digital data values arc then applied to each of the groupings of cells on each of said plurality of 
substrates. 

26. The method of decoding of claim 25 fiirther comprising creating a series of images of the groupings of 
ceUs from said plurality of digitally encoded siibstrates wberetn the steps of determining the locations of ceUs 

30 and deriving digital data values arc then appUed to each of the scries of images of said plurality of digitally 
encoded substrates. 

27. A^data stractoie for a datatile stored on a computer usable substrate, the datatile being used by a program 
operating on a computer system to decode a series of digital data values, the data structure comprising: 

35 a first scries of cells ami corresponding spots representing the digital data values, the digital data 

values being represented by the presence or absence in each of the cells of corresponding spots having 
predetermined attributes atul, 

a second series of cells and corresponding spots representing digital information from which at least 
the predetermined attributes of the spots in the first series of cdls may be determined. 
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28. The data structure of claim 27 wherein each cell represents a plurality of digital data values, each digital 
data value represented by one of a plurality of spots having different predetermined attributes. 

5 29. A method of encoding data into a pattern as digital data comprising: 

formatting the data into a series of digital data values formatted into a plurality of spaces with at 
least one grouping of spaces further formatted into a plorality of subgroi^ings of contiguous spaces each 
formatted into a plurality of rows and a plurality of colunms where each subgrouping is bordered on at least 
one side by a series of maiken used as guideposts in determining the locations of the spaces, and where at 
10 least one bit in said series of digital data values is represented in each of said plurality of spaces where at 
least one logical state is expressed by the presence in the space of a spot of a particular spot size and at least 
one other logical state is expressed by the absence of a spot with said particular spot size from the space. 

30. A method of transmitting data as digital data comprising 

1 5 selecting at least one value for at least one format parameter from a plurality of values for the 

parameter. 

formatting the data into a series of digital data values wherein the series of digital data values are 
formatted into a plurality of cells at least some of liriiich are of a-celi:Size with diiiieiiaons M=paxel&^^ 
N pixels high where if a value has been selected for a format parameter determining the width of a cell then 

20 M equals the value so selected, and where if a value has been selected for a format parameter determining the 
height of the cell then N equals the value so selected, and wherein each cell represents at least one bit in said 
series of digital dau values where at least one logical state is expressed by the absence from the cell of a qxit 
of spot size with dimensions X pixels wide by Y pixels higfi in the cell and at least one other logical state is 
expressed by the presence of a spot in the cell of a spot size with dimensions X pixels wide by Y pixels high, 

25 where if a value has been selected for a format parameter determining the width of a spot then X equals the 
value so selected, and where if a value has been selected for a format parameter determining the height of a 
spot then Y equals the value so selected, and wherein said formatting is done in accordance with such other 
values of format parameters as have been selected, 
distributing the formatted digital data, and 

30 decoding the formatted digital data received such that the original data is reconstructed by the 

decoding means. 

31. The method of transmitting data of claim 30 wherein said disttibttt ing:cotisists^ o^facsitnile transtiriS5ion. 

33 32. The tnethodoftranstnitting data ofclaim 30 wherein the digitally encoded substrate is fu^ 

with human readable information and where said digital data includes a digital representation of said himian 
readable information and where said method of transmitting data further comprises displaying an image of 
said himsan readable information. 
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33. The method of transmitting data of claim 30 wherein said formatted digital data comprises a computer 
file designed to be ran automatically upon completion of the decoding and wherein the method of 
transmitting data further comprises conrnienctng execution of said computer file. 

5 34. The method of transmitting data of claim 30 wherein said formatted digital data comprises a computer 
file associated with a particular application software and wherein the method of transmitting data further 
comprises launching said particular application software where said launching includes loading of said 
computer file within said partictilar application software whereby the computer decoding said formatted 
digital data presents upon decoding immediate access to said computer file for viewing and further 
10 manipulation. 

35. A method of accessing data comprising: 

producing digital instructions for accessing data, 

formatting into a pattern the series of digital data values representing said digital instructions for 
15 accessing data, 

distributing the pattern of formaued digital data, 
decoding the pattern of formatted digital data, and 

acrivaiing;thfi^ digifaUiiKrrnrrinf«:Ti ii^t i-F^.Ua^^g g a^^i^iCTPh y ihg data IS aCCeSSed. 

20 36. The method of accessing dau of claim 35 wherein said digital instructions for accessing data consists of 
hyperlinks to information extraneous to said formatted digital data. 

37. A computer usable mcdiom having computer readable program code means embodied in said medium 
for causing said computer to perform method steps for decoding digital data values formatted in at least one 
25 patterii, the at least one pattern omfiprisiiig a series GfcelU and spots; each spot correspond 
the method steps comprising: 

deterinining the locations of at least a fir^ arid a second gioiq> of cells in the patteiii; 
deriving from the first group of cells information from which at least the format of the cells and 
spots in the second group of cells may be determined; and 
30 deriving the digital data values from the second group of cells using the format informatioru 

3S. The computer usable medium of claim 37 wherein the step performed by the computer of determining 
thetiocationsHO^the^m^aitd'secoiid groups of cells further comprises locating a landmark from which the 
location of the first group may be determined and deriving information from the first group of cells from 
35 which the location of the second group may be determined. 

39. A method of activating any of a plurality of functionalities capable of being activated by digital 
instructions comprising the steps of: 

producing digital instructions for activating at least one of said plurality of fimctionalities, 
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fonnatting into a pattern the series of digital data values representing said digital instnictions, 
decoding the pattern of formatted digital data values, and 

activating said digital instnictions, whereby said at least one of said plurality of iunctionalities is 
activated. 

5 

40. The method of activating any of a plurality of functionalities of claim 39 further comprising the step of 
providing human readable information which relates to the pattern of formatted digital data values. 

41. The method of activating any of a plurality of functionalities of claim 40 where the human readable 
1 0 information includes a description of at least one functionality being activated. 

42. The method of activating any of a plurality of functionalities of claim 40 where the human readable 
information includes a description of the steps to be taken to decode the pattern of digital data values. 
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Box ] ObservatioDS where certain claims were found unsearchable (CoatinuatioD of item 1 of first shed) 



This international rcpoit has not been established in respect of certain chunu under Aitklc i7(2)<&) ior the following reasons: 

1- I I Claims Nos.: 

because they relate to subject matter not required to be searched by this Authority, namely; 



2. I I Claims Noi.: 

^ — ' because they relate to parts of the international application that do not comply with the prescribed requircmenu to such 
an extent that no meaningful international search can be carried out, specifically: 



3. Q CUimsNos.: 

because they aiv dependent claims and are not drafted in accordance with the second and third scmenoes of Rule 6.4<a). 
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This International Searching Authority found multiple inventions in this intcmalional application, as follows: 
Please Sec Extra Sheet. 



1 , As all required additional search fees were timely paid by the applicant, this international search report covers all searchable 



claims. 



2. As all searchable claims could be searched without effort justifying an additional fee, this Authority .^d not invite payment 
of any ^Jditional fee. 

3 . As only some of the required additional search fees were timely paid by the applicant, this international search report covers 
only those claims for which fees were paid, specifically claims Nos.: 



4. I I No required additional search fees were timely paid by the applicant. Consequently, this international search report is 
restricted to the invention first mentioned in the claims; it is covered by claims Nos.: 



Remark oo Protest | | The additional search fees were accompanied by the applicant's protest. 

I I No protest accompanied the payment of additional search fees. 
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BOX II. OBSERVATIONS WHERE UNITY OF INVENTION WAS LACIGNG 
This ISA found multiple inventions as follows: 

Group \, claims 1-19 and 27-2S. drawn to a code and a method for encoding a code, classifted in Class 235. Subclass 
494. 

Group U, cUinu 20-26« 37-38. drawn to a specific deooding meihad specified in Class 235* Subclass 462. 

Group 111. claims 30-36 and 3S. drawn to the method of accessing^ activating, and transmioing data classified in Class 

235, subclass 375. 



The inventions listed as Groups I. II and III do not relate to a single inventive concept under PCT. Rule 13.2 because, 
under PCT Rule 13.2, they lack the same or corresponding special technical features for the following reasons: 

The speciiic code of Group J may requires decoding method which differs from the method as recited in Group II. 
Group III is patentably distinct since it docs not require the specific of the code and the method of decoding as recited 
in Group 1 and 11. 
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